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Preface 


This book is primarily intended for junior-level students who take the courses on 
‘signals and systems’. It may be useful as a reference text for practicing engineers 
and scientists who want to acquire some of the concepts required for signal process¬ 
ing. The readers are assumed to know the basics about linear algebra, calculus (on 
complex numbers, differentiation, and integration), differential equations, Laplace 
transform, and MATLAB®. Some knowledge about circuit systems will be helpful. 

Knowledge in signals and systems is crucial to students majoring in Electrical 
Engineering. The main objective of this book is to make the readers prepared for 
studying advanced subjects on signal processing, communication, and control by 
covering from the basic concepts of signals and systems to manual-like introduc¬ 
tions of how to use the MATLAB® and Simulink® tools for signal analysis and 
filter design. The features of this book can be summarized as follows: 

1. It not only introduces the four Fourier analysis tools, CTFS (continuous-time 
Fourier series), CTFT (continuous-time Fourier transform), DFT (discrete-time 
Fourier transform), and DTFS (discrete-time Fourier series), but also illuminates 
the relationship among them so that the readers can realize why only the DFT of 
the four tools is used for practical spectral analysis and why/how it differs from 
the other ones, and further, think about how to reduce the difference to get better 
information about the spectral characteristics of signals from the DFT analysis. 

2. Continuous-time and discrete-time signals/systems are presented in parallel to 
save the time/space for explaining the two similar ones and increase the under¬ 
standing as far as there is no concern over causing confusion. 

3. It covers most of the theoretical foundations and mathematical derivations that 
will be used in higher-level related subjects such as signal processing, commu¬ 
nication, and control, minimizing the mathematical difficulty and computational 
burden. 

4. Most examples/problems are titled to illustrate key concepts, stimulate interest, 
or bring out connections with any application so that the readers can appreciate 
what the examples/problems should be studied for. 

5. MATLAB® is integrated extensively into the text with a dual purpose. One 
is to let the readers know the existence and feel the power of such software 
tools as help them in computing and plotting. The other is to help them to 
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realize the physical meaning, interpretation, and/or application of such concepts 
as convolution, correlation, time/frequency response, Fourier analyses, and then- 
results, etc. 

6. The MATLAB® commands and Simulink® blocksets for signal processing 
application are summarized in the appendices in the expectation of being used 
like a manual. The authors made no assumption that the readers are proficient in 
MATLAB® . However, they do not hide their expectation that the readers will 
get interested in using the MATLAB® and Simulink® for signal analysis and 
filter design by trying to understand the MATLAB® programs attached to some 
conceptually or practically important examples/problems and be able to modify 
them for solving their own problems. 

The contents of this book are derived from the works of many (known or 
unknown) great scientists, scholars, and researchers, all of whom are deeply appre¬ 
ciated. We would like to thank the reviewers for their valuable comments and 
suggestions, which contribute to enriching this book. 

We also thank the people of the School of Electronic & Electrical Engineering, 
Chung-Ang University for giving us an academic environment. Without affections 
and supports of our families and friends, this book could not be written. Special 
thanks should be given to Senior Researcher Yong-Suk Park of KETI (Korea Elec¬ 
tronics Technology Institute) for his invaluable help in correction. We gratefully 
acknowledge the editorial and production staff of Springer-Verlag, Inc. including 
Dr. Christoph Baumann and Ms. Divya Sreenivasan, Integra. 

Any questions, comments, and suggestions regarding this book are welcome. 
They should be sent to wyyang53 @hanmail.net. 


Won Y. Yang 
Tae G. Chang 
Ik H. Song 
Yong S. Cho 
Jun Heo 
Won G. Jeon 
Jeong W. Lee 
Jae K. Kim 


Seoul, Korea 
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In this chapter we introduce the mathematical descriptions of signals and sys¬ 
tems. We also discuss the basic concepts on signal and system analysis such as 
linearity, time-invariance, causality, stability, impulse response, and system function 
(transfer function). 
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1.1 Signals 

1.1.1 Various Types of Signal 
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A sienal. HpjtSv eying information general |§||j 

system, is represented mathematically as a function of one or more independent 
variables. For example, a speech signal may be represented as an amplitude function 
of time and a picture as a brightness function of two spatial variables. Depending 
on whether the independent variables and the values of a signal are continuous or 
discrete, the signal can be classified as follows (see Fig. 1.1 for examples): 


Continuous-time signal 
Discrete-time signal (sequence) 
Continuous-amplitude(value) signal 
Discrete-amplitude(value) signal 


x(t): defined at a continuum of times. 
x[n\ = x(nT ): defined at discrete times. 
x c : continuous in value (amplitude). 

Xd'. discrete in value (amplitude). 


Here, the bracket [] indicates that the independent variable n takes only integer 
values. A continuous-time continuous-amplitude signal is called an analog signal 
while a discrete-time discrete-amplitude signal is called a digital signal. The ADC 
(analog-to-digital converter) converting an analog signal to a digital one usually 
performs the operations of sampling-and-hold, quantization, and encoding. How¬ 
ever, throughout this book, we ignore the quantization effect and use “discrete-time 
signal/system” and “digital signal/system” interchangeably. 


Continuous-time Continuous-time Continuous-time 
continuous-amplitude continuous-amplitude continuous-amplitude 
signal sampled signal signal 

x(t) x,(f) it(f) —• 


Discrete-time Continuous-time 

discrete-amplitude discrete-amplitude 
signal signal 



hold A/D conversion D/A conversion 

JIM 

(c) (d) (e) 


Fig. 1.1 Various types of signal 


1.1.2 Continuous/Discrete-Time Signals 

In this section, we introduce several elementary signals which not only occur fre¬ 
quently in nature, but also serve as building blocks for constructing many other 
signals. (See Figs. 1.2 and 1.3.) 




I.1 Signals 



0 1 0 10 
(a2) Unit impulse function (b2) Unit impulse sequence 



0 D 1 0 D 10 


(a3) Rectangular pulse function (b3) Rectangular pulse sequence 



(a4) Triangular pulse function (b4) Triangular pulse sequence 



0 1 0 10 
(a5) Exponential function (b5) Exponential sequence 



0 1 0 10 


(a6) Real sinusoidal function (b6) Real sinusoidal sequence 


1.1.2.1a Unit step function 


1.1.2.1b Unit step sequence 



for t > 0 
for t < 0 



(1.1.1a) 


0 fc 


> 0 
< 0 


(1.1.1b) 
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Fig. 1.3 Continuous-time/discrete-time complex exponential signals 


(cf.) A delayed and scaled step function 


(cf.) A delayed and scaled step sequence 


Au s (t - to) = 


for t > t 0 


for t < to 


Au s [n - no\ 


j A 
1 ° 


for n > no 
for n < no 


1.1.2.2a Unit impulse function 


1.1.2.2b Unit sample or impulse sequence 


m = 

at 


oo for t = 0 
0 for t ^ 0 

(1.1.2a) 



for « = 0 
for u ^ 0 


(1.1.2b) 


(cf.) A delayed and scaled impulse 
function 


(cf.) A delayed and scaled impulse 
sequence 


AS(t -1 0 ) m 


I Aoo 
0 


for t = to 
for t ± to 


A <5[n - no] 


\ 

0 


for 

for 


= n 0 
± no 
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(cf.) Relationship between 8(t ) and u s (t) 

8(f) = d «,(/) (1.1.3a) 

at 

u s (t)= J 8{z)dz (1.1.4a) 

1.1.2.3a Rectangular pulse function 

r D (t) = u s (t) - u s (t ~ D) (1.1.5a) 

I I for 0 <t<D(D: duration) 
0 elsewhere 

1.1.2.4a Unit triangular pulse function 

, _ f 1 - 1 1- D\/D for \t-D\<D 

Dt) |0 elsewhere 

(1.1.6a) 

1.1.2.5a Real exponential function 


x(t) = e a, u s (t) = 


for t > 0 
| 0 for t < 0 

(1.1.7a) 

1.1,2.6a Real sinusoidal function 
x(t ) = cos(cuit + <f>) = Re{e^® l(+ ^} 

(1.1.8a) 

1.1.2.7a Complex exponential function 

x(t) = e Slt = e ait e j<0l> with si = o\ + jco \| 
(1.1.9a) 

Note that determines the changing 
rate or the time constant and a)\ the 
oscillation frequency. 

1.1.2.8a Complex sinusoidal function 


x(f) = e ja 


= cos(cuif) + j sin(«it) 
(1.1.10a) 


(cf) Relationship between 8[n] and u s [n] 
8[n] = u s [n] - u s [n - 1] (1.1.3b) 

u s [n] = Yll—oo S[m] (1.1.4b) 
1.1.2.3b Rectangular pulse sequence 

r D [n] = u s [n] - u s [n - D] (1.1.5b) 

I I for 0 < n < D (D : duration) 
0 elsewhere 

1.1.2.4b Unit triangular pulse sequence 

(1.1.6b) 

1.1.2.5b Real exponential sequence 

,[»] = «"«.[»] =\ a " f ° rn -° 

[0 forn < 0 

(1.1.7b) 

1.1.2.6b Real sinusoidal sequence 
x[n ] = cos(£2in + (j>) — Re 

(1.1.8b) 

1.1.2.7b Complex exponential function 


= 7l = r?eJ Q ' n with zi = rie ja ' 
(1.1.9b) 


x[n] = z" 


Note that r\ determines the changing 
rate and the oscillation frequency. 

1.1.2.8b Complex sinusoidal sequence 

x[n] = e JQin = cos (£2in) + j sin^n) 

(1.1.10b) 
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1.1.3 Analog Frequency and Digital Frequency 

A continuous-time signal x(t) is periodic with period P if P is generally the smallest 
positive value such that x(t + P) = x(t). Let us consider a continuous-time periodic 
signal described by 


x(t) = e™t ( 1 . 1 . 11 ) 

The analog or continuous-time (angular) frequency 1 of this signal is co\ [rad/s] and 
its period is 


P = — [s] (1.1.12) 

CO! 

where 

e im(t+P) _ gjmt y J (. - Wl p — 2n=$. e i w ' p = l) (1.1.13) 

If we sample the signal x(t) = e jn,,t periodically at t = nT, we get a discrete¬ 
time signal 

x[ri\ = e ja>inT = e jQ,n with £2r = co\T (1.1.14) 

Will this signal be periodic in n? You may well think that x[n] is also periodic 
for any sampling interval T since it is obtained from the samples of a continuous¬ 
time periodic signal. However, the discrete-time signal x[ri\ is periodic only when 
the sampling interval T is the continuous-time period P multiplied by a rational 
number, as can be seen from comparing Fig. 1.4(a) and (b). If we sample x(t ) = 
e po,t to get x\ri] = e’ 0J,nT — e' n '" with a sampling interval T = mP/N [s/sample] 
where the two integers m and N are relatively prime (coprime), i.e., they have no 
common divisor except 1, the discrete-time signal x[n] is also periodic with the 
digital or discrete-time frequency 

mP m 

= co\T = co\ -= —2 7t [rad/sample] (1.1.15) 

N N 

The period of the discrete-time periodic signal x[ri] is 

N — [sample], (1.1.16) 

where 

e jVdn+N) e jnm e j2mn _ y „ (1.1.17) 


1 Note that we call the angular or radian frequency measured in [rad/s] just the frequency with¬ 
out the modifier ‘radian’ or ‘angular’ as long as it can not be confused with the ‘real’ frequency 
measured in [Hz], 
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(a) Sampling x(t) = sin(37rf) with sample period 7=0.25 



(b) Sampling x(t) = sin(37rt) with sample period T = Mtt 


Fig. 1.4 Sampling a continuous-time periodic signal 

This is the counterpart of Eq. (1.1.12) in the discrete-time case. There are several 

observations as summarized in the following remark: 

Remark 1.1 Analog (Continuous-Time) Frequency and Digital (Discrete-Time) 

Frequency 

(1) In order for a discrete-time signal to be periodic with period N (being an 
integer), the digital frequency £2i must be tv times a rational number. 

(2) The period A of a discrete-time signal with digital frequency £2i is the mini¬ 
mum positive integer to be multiplied by £2| to make an integer times lit like 
2m tv (m: an integer). 

(3) In the case of a continuous-time periodic signal with analog frequency co i, it 
can be seen to oscillate with higher frequency as u>\ increases. In the case of 
a discrete-time periodic signal with digital frequency £21, it is seen to oscillate 
faster as £2| increases from 0 to tc (see Fig. 1.5(a)-(d)). However, it is seen 
to oscillate rather slower as £2! increases from tv to 2n (see Fig. 1.5(d)-(h)). 
Particularly with £2i = 2n (Fig. 1.5(h)) or 2m tc, it is not distinguishable from 
a DC signal with £2i = 0. The discrete-time periodic signal is seen to oscillate 
faster as £2| increases from 2tv to 371 (Fig. 1.5(h) and (i)) and slower again as 
£21 increases from 37r to An. 
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0 0.5 1 1.5 2 

(c) C0S(37rnT), 7 = 0.25 




(i) cosIgnnT), 7 = 0.25 


Fig. 1.5 Continuous-time/discrete-time periodic signals with increasing analog/digital frequency 


This implies that the frequency characteristic of a discrete-time signal is peri¬ 
odic with period 2n in the digital frequency £2. This is because e ,n '" is also 
periodic with period 2it in £2 lf i.e., e ,<S2 ' +2 "'' T) " = e /Q| V ,2 "" ,7r = e' Q ' n for any 
integer m. 

(4) Note that if a discrete-time signal obtained from sampling a continuous-time 
periodic signal has the digital frequency higher than tv [rad] (in its absolute 
value), it can be identical to a lower-frequency signal in discrete time. Such a 
phenomenon is called aliasing, which appears as the stroboscopic effect or the 
wagon-wheel effect that wagon wheels, helicopter rotors, or aircraft propellers 
in film seem to rotate more slowly than the true rotation, stand stationary, or 
even rotate in the opposite direction from the true rotation (the reverse rotation 
effect). [W-l] 


1.1.4 Properties of the Unit Impulse Function 
and Unit Sample Sequence 

In Sect. 1.1.2, the unit impulse, also called the Dirac delta, function is defined by 
Eq. (1.1.2a) as 


m = 


d_ 

dt 


u s (t ) = 


00 

0 


for t = 0 
for 7 ^ 0 


(1.1.18) 
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Several useful properties of the unit impulse function are summarized in the follow¬ 
ing remark: 

Remark 1.2a Properties of the Unit Impulse Function 8(t) 

(1) The unit impulse function 8(t ) has unity area around t = 0, which means 

J + 8(z)dz = 8(z)dz = 1 (1.1.19) 

J 8(z)dz-J 8(z)dz (1 '= 4a) n s (0 + ) — u s (0~) =1—0=1 

(2) The unit impulse function 8(t ) is symmetric about t = 0, which is described by 

8(t) = 8(-t) (1.1.20) 


(3) The convolution of a time function x(t ) and the unit impulse function 8(t) makes 
the function itself: 

x(t) * 8(f) definit . on ^=j u . on iMegrai J + x(z)8(t - z)dz = x(t) (1.1.21) 

x(z)S(l x)dx i( '“ r)7 ‘°£ r only y+® x(t)&(t - x)dr ,nde! i? de " , of r A (,) g(t - x)dr\ 
x(t) &{t’)(-df) =x(t) s(t'w=x(t) /+“ s(x)dx (, = 9) X (t) ) 


What about the convolution of a time function x(t ) and a delayed unit impulse 
function 8(t — t\ )? It becomes the delayed time function x(t — t\ ), that is, 

x(t) * 8(t - h) = f x(z)8(t — z — t\)dz = x(t — t\) (1.1.22) 


What about the convolution of a delayed time function x(t — tj) and a delayed 
unit impulse function 8(t — ti)? It becomes another delayed time function x(t — 
t\ — ti), that is, 


x(t-t 2 )*8(t-h) = J x(z-t 2 )8(t-z-h)dz=x(t-h-t 2 ) (1.1.23) 
If x(t) * y(t) = z(t), we have 

x(t - t\) * y(t - ti) = z(t - t\ - ti) (1.1.24) 

However, with t replaced with t — t\ on both sides, it does not hold, i.e., 
x(t - ti) * y(t - ti) + z(t - ti), but x(t - ti)* y(t - ti) = z(t - 2ti) 



1 Signals and Systems 


(4) The unit impulse function S(t) has the sampling or sifting property that 

J x(t)S(t -h)dt Mt ?l) ^ 0 = ° nly ‘- h x(h) j 8{t — t\)dt (1 = 9) x(ti) 

(1.1.25) 


This property enables us to sample or sift the sample value of a continuous-time 
signal x(t) at t = t\. It can also be used to model a discrete-time signal obtained 
from sampling a continuous-time signal. 


In Sect. 1.1.2, the unit-sample, also called the Kronecker delta, sequence is 
defined by Eq. (1.1.2b) as 


S[n] = 


0 


for n = 0 
for n ^ 0 


(1.1.26) 


This is the discrete-time counterpart of the unit impulse function 8(t ) and thus is 
also called the discrete-time impulse. Several useful properties of the unit-sample 
sequence are summarized in the following remark: 


Remark 1.2b Properties of the Unit-Sample Sequence 8[n\ 

(1) LikeEq. (1.1.20) for the unit impulse 8(t), the unit-sample sequence 8[ri\ is also 
symmetric about n = 0, which is described by 

5[n] = 8[-n ] (1.1.27) 

(2) Like Eq. (1.1.21) for the unit impulse 8(t), the convolution of a time sequence 
x[n ] and the unit-sample sequence 8[n] makes the sequence itself: 

x[n] * <5[n] deflnition of c =E nvolution sum ~m]=x[n] (El.28) 

f v E~=-00 x[m]8[n - m] S[n ~ m] = ° nly m= " -oo x[n]S[n - m]' 

, W independent of “ x[n] ^_ 5[ „ _ m] 

v ml/ ° = ° nly m ~"x[n]8[n - n] (1 = 26) x [n\ , 
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(3) Like Eqs. (1.1.22) and (1.1.23) for the unit impulse 8(t), the convolution of a 
time sequence x[n] and a delayed unit-sample sequence 8[n — n{\ makes the 
delayed sequence x[n — m]: 

x[n] * 8[n - m] = Er=-oo X[m]8[n ~ m ~ Hl] =x[n ~ ni] (LL29) 
x[n - n 2 \ *8[n-m] = ^2 m=oo x[m - n 2 ]8[n -m- m] =x[n - m - n 2 ] 

(1.1.30) 


Also like Eq. (1.1.24), we have 

x[n\ * y[n] = z[n] =$■ x[n - m\ * y[n - n 2 \ = z[n -n x - n 2 ] (1.1.31) 

(4) Like (1.1.25), the unit-sample sequence <5[«] has the sampling or sifting prop¬ 
erty that 

J2Z-oo X[n]S[n ~ ni] = T,Z-oo X[n iW" -«!]=*[«!] (1.L32) 


1.1.5 Several Models for the Unit Impulse Function 


As depicted in Fig. 1.6(a)-(d), the unit impulse function can be modeled by the limit 
of various functions as follows: 


— 8(t) = lim — X D (t + D) 


(1.1.33a) 

(1.1.33b) 

(1.1.33c) 

(1.1.33d) 


Note that scaling up/down the impulse function horizontally is equivalent to scaling 
it up/down vertically, that is, 


8(at) = ,‘,5(0 (1.1.34) 

\a\ 

It is easy to show this fact with any one of Eqs. (1.1.33a-d). Especially for 
Eq. (1.1.33a), that is the sine function model of 8(t), we can prove the validity of 
Eq. (1.1.34) as follows: 
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-1.5 -1 -0.5 0 0.5 1 1.5 


(b) ^fb(f + f) 



-0.5 0 

( c ) ( f+ D) 



■1.5 -1 -0.5 0 

(d) 


Fig. 1.6 Various models of the unit impulse function S(t) 


1 sin(7r at/D) 
D nat/D 


Hm 1 sm(jtt/(D/a)) 

zvi™o+ \ a \(D/\a\) nt/{D/a) 


D/\a\-±D' 


J_ sin(:7r?/£>') (i.i33a) J_ 

D’ nt/D ' \a\ (t 


On the other hand, the unit-sample or impulse sequence <5[n] can be written 


where the sine function is defined 


. sin(7rx) 

sinc(x) = - 

Ttx 


(1.1.35) 


(1.1.36) 


1.2 Systems 

A system is a plant or a process that produces a response called an output in 
response to an excitation called an input. If a system’s input and output signals 
are scalars, the system is called a single-input single-output (SISO) system. If a 
system’s input and output signals are vectors, the system is called a multiple-input 
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the input |-1 the output I the input .-. the output 

*(*)— | G | — *~y(t) = G{x(t)} x[n] —> j G | —►- y[n] = G{x[n]} 

(a) A continuous-time system (b) A discrete-time system 

Fig. 1.7 A description of continuous-time and discrete-time systems 

multiple-output (MIMO) system. A single-input multiple-output (SIMO) system and 
a multiple-input single-output (MISO) system can also be defined in a similar way. 
For example, a spring-damper-mass system is a mechanical system whose output 
to an input force is the displacement and velocity of the mass. Another example 
is an electric circuit whose inputs are voltage/current sources and whose outputs 
are voltages/currents/charges in the circuit. A mathematical operation or a com¬ 
puter program transforming input argument(s) (together with the initial conditions) 
into output argument(s) as a model of a plant or a process may also be called 
a system. 

A system is called a continuous-time/discrete-time system if its input and output 
are both continuous-time/discrete-time signals. Continuous-time/discrete-time sys¬ 
tems with the input and output are often described by the following equations and 
the block diagrams depicted in Fig. 1.7(a)/(b). 

Continuous-time system Discrete-time system 

X(f) ^ >•(*); y(t) = G{x(t)} x[n] ^ y[n\, y[n\ = G{x[n]} 

1.2.1 Linear System and Superposition Principle 

A system is said to be linear if the superposition principle holds in the sense that it 
satisfies the following properties: 

- Additivity: The output of the system excited by more than one independent 

input is the algebraic sum of its outputs to each of the inputs 
applied individually. 

- Homogeneity : The output of the system to a single independent input is 

proportional to the input. 

This superposition principle can be expressed as follows: 

If the output to Xj(t) is >’,(;) = G {*,(/)}, If the output to x,[n] is >’,[«] = 
the output to J2 a i x i( t ) i s G{Xi[n]}, the output to Y. a i x i M is 

that is, J2 a i G {Xi [n]}, that is, 
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G 


= £>G{*,(0) 

= J2 a iyi (1.2.1a) 


G |^a,x ( [n]J = ^a,G{x,[n]} 

= J>M n] d.2.1b) 


(Ex) A continuous-time linear system 
yit) = 2 x(t) 

(Ex) A continuous-time nonlinear system 
y(t) = x(t) + 1 


(Ex) A discrete-time linear system 

M = 

(Ex) A discrete-time nonlinear system 
y[n] = x 2 [n\ 


Remark 1.3 Linearity and Incremental Linearity 

(1) Linear systems possess a property that zero input yields zero output. 

(2) Suppose we have a system which is essentially linear and contains some 
memory (energy storage) elements. If the system has nonzero initial condi¬ 
tion, it is not linear any longer, but just incrementally linear, since it violates 
the zero-input/zero-output condition and responds linearly to changes in the 
input. However, if the initial condition is regarded as a kind of input usually 
represented by impulse functions, then the system may be considered to be 
linear. 


1.2.2 Time/Shift-Invariant System 

A system is said to be time/shift-invariant if a delay/shift in the input causes 
only the same amount of delay/shift in the output without causing any change of 
the charactersitic (shape) of the output. Time/shift-invariance can be expressed as 
follows: 


If the output to x(t) is y(t), the output to 
x(t - h) is y(t - h), i.e., 

G{xlt-h)} = y(t-h) (1.2.2a) 

(Ex) A continuous-time time-invariant 
system 

y{t) = sin(.x(0) 


If the output to x\n ] is >’[«], the output 
to x[n — /it] is y[n — m], i.e., 

G {x[n - m]} = y[n - m\ (1.2.2b) 

(Ex) A discrete-time time-invariant 
system 

y[n] = ^(x[n-l]+x[n]+x[n + W 
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(Ex) A continuous-time time-varying (Ex) A discrete-time time-varying 
system system 


y’{t) = (sin(f) - l)y(t) + x(t) 


y[n] = -y[n-l]+x[n] 


1.2.3 Input-Output Relationship of Linear 
Time-Invariant (LTI) System 

Let us consider the output of a continuous-time linear time-invariant (LTI) system 
G to an input x(t). As depicted in Fig. 1.8, a continuous-time signal x(t) of any 
arbitrary shape can be approximated by a linear combination of many scaled and 
shifted rectangular pulses as 


m = YZ=-oo x{mT) f rT y + 2~ mT ) T T ^S: 

x(t) = lim x(t) = J x(z)8(t — r)dr = x(t) *8(t ) 


Based on the linearity and time-invariance of the system, we can apply the superpo¬ 
sition principle to write the output y(t) to x(t) and its limit as T 0: 


y(t) = G{x(t)} = X!r=-oo x ^ mT ^ T (t ~ mT)T 

y(t) = G{x(t)} = f x(r)g(t - r)dr = x(t)*g(t) (1.2.4) 


Here we have used the fact that the limit of the unit-area rectangular pulse response 
as T —> 0 i s the impulse response g(t), which is the output of a system to a unit 
impulse input: 



pulse shifted by -772 combination of scaled/shifted rectangular pulses 


Fig. 1.8 The approximation of a continuous-time signal using rectangular pulses 
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g r (t) = G I —r T (t + — j | : the response of the LTI system to a unit-area 
v ' ' rectangular pulse input 

r -5 0 ito grW =l™G(i rr (, + |)| 

= G j lim ^ r T (t + ^ | <L = 3b) G{S(t)} = g(t) (1.2.5) 

To summarize, we have an important and fundamental input-output relationship 
(1.2.4) of a continuous-time LTI system (described by a convolution integral in 
the time domain) and its Laplace transform (described by a multiplication in the 
s-domain) 


y(t) = JC(0* g(t) La 3: m y(5) = X(s)G(s) (1.2.6) 

where the convolution integral, also called the continuous-time convolution, is 
defined as 

x(t)*g(t) = J x(r)g(t - r)dr = J g(r)x(t - x)dx = g(t)* x(t) (1.2.7) 

(cf.) This implies that the output y(t) of an LTI system to an input can be expressed 
as the convolution (integral) of the input x(t) and the impulse response g(t). 

Now we consider the output of a discrete-time linear time-invariant (LTI) system 
G to an input x[n\. We use Eq. (1.1.28) to express the discrete-time signal x[n] of 
any arbitrary shape as 

x[ n ] n = 28, x[«]* S [n] deflMtI0n ° f = nv °' Ull0n SUm YZ—oo _ (L2.8) 

Based on the linearity and time-invariance of the system, we can apply the superpo¬ 
sition principle to write the output to x[n\. 

y[n ] = G{x[u]} (1 = 8) G {^~ = oo x[m]S[n -/n]} 

im= lty J] m= _ oo x[m]G{S[n - m]} 

time—invariance X [m]g[n - m] = x[n]* g[n ] (1.2.9) 

Here we have used the definition of the impulse response or unit-sample response 
of a discrete-time system together with the linearity and time-invariance of the 
system as 
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G{S[n ]} = g[n ] time “ ce G{S[n - m ]} = g[n - m] 

G{x[m]S[n - m\}“ 1 x[m]G{S[n - m\}^~'=~ x[m\g\n - m ] 

To summarize, we have an important and fundamental input-output relationship 
(1.2.9) of a discrete-time LTI system (described by a convolution sum in the time 
domain) and its z-transform (described by a multiplication in the z-domain) 

y[n] = x[n]* g[n ] I'M = X[z]G[z] (1.2.10) 

where the convolution sum, also called the discrete-time convolution, is defined as 

X[n]* g[n ] = ^2 m= oo x[m]g[n - m] = Y^=-oq ~ = SM* x[n ] 

( 1 . 2 . 11 ) 

(cf.) If you do not know about the z-transform, just think of it as the discrete-time 
counterpart of the Laplace transform and skip the part involved with it. You 
will meet with the z-transform in Chap. 4. 

Figure 1.9 shows the abstract models describing the input-output relationships of 
continuous-time and discrete-time systems. 


1.2.4 Impulse Response and System (Transfer) Function 

The impulse response of a continuous-time/discrete-time linear time-invariant (LTI) 
system G is defined to be the output to a unit impulse input x(t) — S(t)/ 
x[n] = m: 

g(t) = G{S(t)} (1.2.12a) I g[n] = G{S[n]} (1.2.12b) 


As derived in the previous section, the input-output relationship of the system can 
be written as 


' I r Y(s)=X(s)G(s) J transform 
System (transfer) function G(s)=£{g(f)} 


Impulse response g [n] 

I I y\n]=x\n] * q\n\ ^ 

G r V[z]=X[z]G[z] >- transform 
System (transfer) function G[z]=Z[g[n ]} 


(a) A continuous-time system 


(b) A discrete-time system 


Fig. 1.9 The input-output relationships of continuous-time/discrete-time linear time-invariant 
(LTI) systems 
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y(t) ( = 7) x(t)* g(f) 4 F(s) ( = 6) X(s)G(s ) 


yin] 


n, A'|n|*g[«J4 K|z| 


X[z]G[z] 


where x(t)/x[n], y(t)/y[n], and g(t)/g[n] are the input, output, and impulse 
response of the system. Here, the transform of the impulse response, G(s)/G[z], 
is called the system or transfer function of the system. We can also rewrite these 
equations as 


Y(s) C{y(f)} 

G(S) =W) = 


G[z] = 


Y[z ] 
X[z] 


Z{y[n]} 

Z{x[n]} 


= Z{g[n]} 
(1.2.13b) 


This implies another definition or interpretation of the system or transfer function 
as the ratio of the transformed output to the transformed input of a system with no 
initial condition. 


1.2.5 Step Response, Pulse Response, and Impulse Response 

Let us consider a continuous-time LTI system with the impulse response and transfer 
function given by 

g{t) = e~ a, u s {t ) and G(s) <L = 3a) £{g(t)} = &{e~ at u s {t)}™ & = K5) , 

(1.2.14) 


respectively. We can use Eq. (1.2.6) to get the step response, that is the output to the 
unit step input x{t ) = lift) with X(s) TaWe = 1(3) 1/i, as 


11 1/1 1 \ 

yft) = C-\Yfs)}™*= m5) 1(1 - e~ a, )u s {t) (1.2.15) 


Now, let a unity-area rectangular pulse input of duration (pulsewidth) T and 
height l/T 


-(uft) - u s (t - T)); X(s) = C{x{t)} = - C{u s (t) - uft - T)} 


Table A. 1(3), A.2(2) 1/1 _ Ts 1 \ 
r{^~ e ~s) 


(1.2.16) 


be applied to the system. Then the output gr(t), called the pulse response, is 
obtained as 
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Fig. 1.10 The pulse response and the impulse response 

Y t (s) = G(s)X(s) = l( 1 - e~ Ts - 

T + a) s 


e~ Ts (- - ; grit) = C-'lYAs)} 

aT \s s + a \s s + aJJ 

“*' A ‘® < ™ 4 (d - »-“)»,« - (1 - - 7-)) d.2.17) 


If we let T —» 0 so that the rectangular pulse input becomes an impulse S(t) (of 
instantaneous duration and infinite height), how can the output be expressed? Tak¬ 
ing the limit of the output equation (1.2.17) with T —» 0, we can get the impulse 
response g{t) (see Fig. 1.10): 


grit) r 4° -L ((1 - e a, )u s (t ) - (1 - e aif T) )u s (t)) = ^(e ar ~ l)e a, u s (t) 
(°- 25 ) 1 , , (1.2.14) 

P —(1 +aT - 1 )e~ at u s (t) = e~ at u s (t ) te git) (1.2.18) 

aT—*0 aT 


This implies that as the input gets close to an impulse, the output becomes close to 
the impulse response, which is quite natural for any linear time-invariant system. 

On the other hand, Fig. 1.11 shows the validity of Eq. (1.2.4) insisting that the 
linear combination of scaled/shifted pulse responses gets closer to the true output as 
T -* 0. 


1.2.6 Sinusoidal Steady-State Response 
and Frequency Response 

Let us consider the sinusoidal steady-state response, which is defined to be the ever¬ 
lasting output of a continuous-time system with system function G(s) to a sinusoidal 
input, say, x(t) = A cos(cot + <j>). The expression for the sinusoidal steady-state 
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(a2) The input x (f) and its approximation x(t) with T = 0.25 (b2) The outputs to x(t) and x{t) 

Fig. 1.11 The input-output relationship of a linear time-invariant (LTI) system - convolution 


response can be obtained from the time-domain input-output relationship (1.2.4). 
That is, noting that the sinusoidal input can be written as the sum of two complex 
conjugate exponential functions 

x(t) = A cos (cot + 0) <D ='’ — (e i(mt+ ^ + +0)) — ^-(xi (t) + x 2 (t)), (1.2.19) 

we substitute x\(t) = e for x(t) into Eq. (1.2.4) to obtain a partial steady-state 
response as 


y\(t) = G{xi(t)} (X '= ) j xi(z)g(t - z)dr = J e i(ar+(p) g(t - z)dz 
m y°° e -M<-r) g(t _ T)dT = e m+<t,) J°° e -J<»t g(t)dt 

= e j(wt+4,) G(joj) (1.2.20) 


with 

G(jco) = f er " M g(t)dt ^^2 J™ g(t)e- J,M dt (A = G(s)\ s=ja> (1.2.21) 

Here we have used the definition (A.l) of the Laplace transform under the assump¬ 
tion that the impulse response g(t) is zero 'it < 0 so that the system is causal (see 
Sect. 1.2.9). In fact, every physical system satisfies the assumption of causality that 
its output does not precede the input. Here, G(jco) obtained by substituting s = jco 
(co: the analog frequency of the input signal) into the system function G(s) is called 
the frequency response. 
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The total sinusoidal steady-state response to the sinusoidal input (1.2.19) can be 
expressed as the sum of two complex conjugate terms: 

.V(t) = ^ j e j(a,+(l,) G(jw) + e~ j(aa+ ^G(-jco) j 

= 2 ^e i(<at '^\Gx(Ju>)\e J0(a) + e /<ft " tw |G(-ycw)|e 

= ^|G(7«)||e- /( ® r+<A+<)( ® )) + e -K«f+#+e(o)))J 

A\G(jco)\ cos (cot + <p + 0(co)) (1.2.22) 

where \G(jco)\ and 6(co) = ZG(jco) are the magnitude and phase of the frequency 
response G(jco), respectively. Comparing this steady-state response with the sinu¬ 
soidal input (1.2.19), we see that its amplitude is |G(y&>)l times the amplitude A of 
the input and its phase is 8(oj) plus the phase (j> of the input at the frequency co of 
the input signal. 

(cf.) The system function G(s) (Eq. (1.2.13a)) and frequency response G(jco) 
(Eq. (1.2.21)) of a system are the Laplace transform and Fourier transform 
of the impulse response g(t) of the system, respectively. 

Likewise, the sinusoidal steady-state response of a discrete-time system to a 
sinusoidal input, say, x[n] — A cos(£2n + </>) turns out to be 

y[n] = A|G[e^]| cos(£2n + 0 + 0(fi)) (1.2.23) 


where 


gio . ts ®u 

(1.2.24) 

Here we have used the definition (4.1) of the z-transform. Note that G[e jQ ] obtained 
by substituting z = e jQ (£>: the digital frequency of the input signal) into the system 
function G[z] is called the frequency response. 

Remark 1.4 Frequency Response and Sinusoidal Steady-State Response 

(1) The frequency response G(jco) of a continuous-time system is obtained by sub¬ 
stituting s = jco (co: the analog frequency of the input signal) into the system 
function G(s). Likewise, the frequency response G[e ' n ] of a discrete-time sys¬ 
tem is obtained by substituting z = e' n (Q: the digital frequency of the input 
signal) into the system function G[z]. 
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(2) The steady-state response of a system to a sinusoidal input is also a sinusoidal 
signal of the same frequency. Its amplitude is the amplitude of the input times 
the magnitude of the frequency response at the frequency of the input. Its 
phase is the phase of the input plus the phase of the frequency response at the 
frequency of the input (see Fig. 1.12). 


ln P ut *( f > - , I G ,„ 'I .Output y(t) = 

A cosM \41 G(jv) I cosM + </, + e) 

| G(/u>) |: Magnitude of the frequency response 
e(u) = ZG(ju) : Phase of the frequency response 
(a) A continuous-time system 


Input x[n] = _ | i | O utput y[n] = 

A cos (Cln +^1— -H | G( e' a ) I cos(£2n + 4 + B) 

|G[e' Q ]|: Magnitude of the frequency response 
0(£2) = ZG[e y£! ]: Phase of the frequency response 
(b) A discrete-time system 


Fig. 1.12 The sinusoidal steady-state response of continuous-time/discrete-time linear time- 
invariant systems 


1.2.7 Continuous/Discrete-Time Convolution 

In Sect. 1.2.3, the output of an LTI system was found to be the convolution of the 
input and the impulse response. In this section, we take a look at the process of 
computing the convolution to comprehend its physical meaning and to be able to 
program the convolution process. 

The continuous-time/discrete-time convolution >’(?)/>’[«] of two functions/ 
sequences x(r)/x[zn] and g(r)/g[m] can be obtained by time-reversing one of them, 
say, g{x)/g[m] and time-shifting (sliding) it by t/n to g(t — x)/g[n—m], multiplying 
it with the other, say, x(t)/x[»z], and then integrating/summing the multiplication, 
say, x(t )g(t - x)/x[m]g[n - m ]. Let us take a look at an example. 

Example 1.1 Continuous-Time/Discrete-Time Convolution of Two Rectangular 
Pulses 


(a) Continuous-Time Convolution (Integral) of Two Rectangular Pulse Functions 
r Dl (t) and r Dl (t) Referring to Fig. 1.13(al-a8), you can realize that the 
convolution of the two rectangular pulse functions r Dl (t ) (of duration D\ ) and 
r D 2 (t) (of duration D-i < D\ ) is 


r D i(t)*r D2 (t ) = 


t for 0 < t 

D 2 for D 2 < 

-t + D for D\ < 
0 elsewhere 


< D 2 

t<D l 

t < D = D\ + D 2 


(El.1.1a) 


The procedure of computing this convolution is as follows: 

- (al) and (a2) show r Dl ( r) and r Dl { t), respectively. 

- (a3) shows the time-reversed version of r Dl {r), that is r Dl {—r). Since there is 
no overlap between r Dl (x) and r D2 (—x), the value of the convolution r Dl (t) * 
r Dl (t ) at t = 0 is zero. 



1.2 Sys 


23 



(a4) shows the 02-delay eel version of r Dl (—x), that is r Dl (D2 — r). Since 
this overlaps with r Dl (x) for 0 < r < Do and the multiplication of them is 1 
over the overlapping interval, the integration (area) is O2, which will be the 
value of the convolution at t = O2. In the meantime (from t = 0 to O2), it 
gradually increases from t = 0 to 0 2 in proportion to the lag time t. 

As can be seen from (a4)-(a6), the length of the overlapping interval between 
r D 2 (t — x ) an d r Dl (r) and the integration of the multiplication is kept constant 
as D2 till r Dl (t — x) is slided by D\ to touch the right end of r Dl (z). Thus the 
value of the convolution is D2 all over Do < t < D\. 
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- While the sliding r Dl (t — t) passes by the right end of r Dl (x), the length of 
the overlapping interval with r Dl (r) and the integration of the multiplication 
decreases gradually from Do to 0 till it passes through the right end of r Dl (t) 
at t — D\ + D 2 as shown in (a7). 

- After the left end of r Dl (t — r) passes by the right end of r Dl (t) at t — 
D i + Do, there is no overlap and thus the value of the convolution is zero all 
over t > Di + D 2 . 

- The convolution obtained above is plotted against the time lag t in (a8). 

(b) Discrete-Time Convolution (Sum) of Two Rectangular Pulse Sequences r Dl [n] 
and r Dl [n] Referring to Fig. 1.13(bl-b8), you can realize that the convolution 
of the two rectangular pulse sequences r Dl [n] (of duration Di ) and r !h [n] (of 
duration D 2 < D\) is as follows: 


r D \[n\*r Dl [n\ = 



for 0 < n < Do 

for D 2 < n < D\ 

for D\ < n < D — D\ + D 2 — 1 

elsewhere 


(El.1.1b) 


The procedure of computing this discrete-time convolution is similar to that 
taken to get the continuous-time convolution in (a). The difference is as follows: 

- The value of r Dl [n] * r Dl [n] is not zero at n = 0 while that of r Dl (t) * r Dl (t) 
is zero at t = 0. 

- The duration of r Di [n\ * r D2 \n\ is from n = 0 to D\ + Do — 2 while that of 
r Dl (t) * r, h (t) is from t = 0 to D, + Do. 


(of.) You had better try to understand the convolution process rather graphically 
than computationally. 

(cf.) Visit the web site <http://www.jhu.edu/~signals/> to appreciate the joy of 
convolution. 


Remark 1.5 Continuous-Time/Discrete-Time Convolution of Two Rectangular 

Pulses 

(1) If the lengths of the two rectangular pulses are D\ and Do (with D| > D 2 ), 
respectively, the continuous-time and discrete-time convolutions have the dura¬ 
tion of D\ + D 2 and D\ + D 2 — 1, respectively and commonly the height 
of D 2 . 

(2) If the lengths of the two rectangular pulses are commonly D, the continuous¬ 
time and discrete-time convolutions are triangular pulses whose durations are 
2D and 2D — 1, respectively and whose heights are commonly D: 


r D {t)*r D {t ) = DX D {t) 
r D [n]*r D [n] = DX D [n] 


(1.2.25a) 

(1.2.25b) 
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2 i—| m 

i r Lr— : 

0 7 2 4 6 t [sec] 

(al)x(f) 


3 



0 7 2 4 6 ([see] 

(a2) g(t) 



0 7 2 4 6 ([sec] 

(a3) y(f) = x(f).gr(() 



0 2 4 6 n 

(b3) y b ln] = x b [n]*g b [n] 


2 I I 

o [jjU u n .... 

0 (cl) x c [n] 10 


2 VM 

0 nnn 


0 5 10 n 

(c2) g c [n] 



0 5 10 n 

(C3)y c [n] = >r c [n].gr c [n] 


Fig. 1.14 Approximation of a continuous-time convolution by a discrete-time convolution 


The above example implies that the continuous-time convolution x(t) * g(t ) can 
be approximated by the limit of a discrete-time convolution x(nT s ) * g(nT s )T s as 
T s —> 0 where is the sampling period. Let us take a look at another example. 

Example 1.2 Approximation of a Continuous-Time Convolution by a Discrete- 
Time One 

Figure 1.14(al), (a2), and (a3) show two continuous-time signals, x(t), g(t), and 
their convolution y(t) = x(t) * g(t), respectively where y(t) is actually a discrete¬ 
time version y(nT s ), which is obtained as follows: 

- We sample x(t) and g(t) every T s = 0.01 [s] to make two sequences x(nT s ) and 
8(nT s ). 

- We use the MATLAB function conv () to compute their discrete-time convolu¬ 
tion and multiply it by the sampling interval T s to get y(nT s ) = x(nT s )*g(nT s )T s 
as we do in the numerical integration. 

Figure 1.14(bl)/(cl), (b2)/(c2), and (b3)/(c3) show two discrete-time signals x\ri\, 
g[n], and their discrete-time convolution y[n] = x[n] * g[n] (computed using 
conv ()), respectively where x[n] and g[n] are obtained by sampling x(t) and g(t) 
with sampling period T s = 1/T S = 0.5. 

Interested readers are welcome to run the following MATLAB program 
“sig01fl4.m”. 
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Nyl=Ny+3; % plotting interval extended by two Samples 



The systems, called tapped delay lines , to be discussed in the following example 
are essentially continuous-time systems. However, they behave like discrete-time 
systems in terms of the input-output relationship and thus are expected to be a link 
between continuous-time systems and discrete-time ones. 

Example 1.3 Tapped Delay Lines 


(a) Tapped Delay Lines 

Consider the continuous-time LTI system depicted in Fig. 1.15(a) where its 
impulse response and system function are 

g(t )= j^Z-oc gnS(t - nT) ; G(s) = C{8(t)]= HT=-oo 8ne ~ 


(El.3.1) 
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Let the input and its Laplace transform be 

x(s) = c[m} =YZ=-oo xme ~ smT 

(El .3.2) 

Then we claim that the output and its Laplace transform will be 

yit) = J2Z-oo ykS(t ~ kT); Y(s) = C{y(t)] = E:_. y* e ~ skT ( E1 - 3 - 3 ) 

with 


y k = X k *g k = EI_ Xmgk-m-, Ylz | = Z{y k ) = X[Z]G[Z] (El.3.4) 


Proof 

y(t ) = JC(0*S(0 = EI_ *m<5(t - »*> EH-oo 

=e:_ e:_. *»*»*(* - w7 >^ - nT ) 

(1 = 3) El-00 El-oo - wr - nJ) 

1=1 El-oo El-oo - kT ) 

=e:_ to _ with = E m= _ 0O xm ^- m 


(b) Tapped Delay Lines with a Zero-Order Hold at its Output Consider the 
continuous-time LTI system with a zero-order hold (z.o.h.) device at its output 
as depicted in Fig. 1.15(b) where its impulse response is 

KO = El-oo SnMt ~ nT) = El-*, Sniu s (t - nT) - u s (t -nT- T)) 

(El.3.5) 

Let the input be 


x (o = El-oo ' XmrAt - mT) = El 

Then we claim that the output will be 


x m {u s {t — mT) — u s {t — mT — T)) 
(El .3.6) 


y(t) = El .00 yk TX T(t - kT) (El.3.7) 


with 


yk 


* = £“ 


lgk~r< 


(El.3.8) 
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k=0 x 0 X(t)= I~ = ^x m 6(t-mT) 

k= 1 *i x 0 

k=2 x 2 x, x 0 


g n : multiplier 

' dela y of T seconds 
: signal distribution point 
o : adder 



(a) Tapped delay lines 


x(t)=^ = -Ar T (t-mT) 

m ,—, m-T) r 


y n m^L-Mt-kT) 


g(t)=ZZ = -„9nr T (t-nT) 


•• |ao4->yf0 
y(f) = 'LL—y k TMt-kT) 


(b) Tapped delay lines with zero-order hold (z.o.h.) device 


Fig. 1.15 Systems for Example 1.3(a) and (b) 


Proof 

y(t) = x(t)*g(t ) = Y m _ QJ *« r r(f - mT)* X!„ = _ 00 8n r r(t - nT) 
= Y Y x m g n r T (t - mT)*r T (t - nT) 
^K,-jZ-^^-rnT-nT) 

Tsi e:_. kLo ^sk-mTXAt ~ kT) 

= l-o^-ooy^rit - kT) with y k = Y^Z=-oo Xm8k ~ m 
(cf.) Fig. 1.14(al-a3) shows the validity of Eq. (El.3.7). 
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1.2.8 Bounded-Input Bounded-Output (BIBO) Stability 

A system is said to be (BIBO) stable if every bounded input produces a bounded 
output. To find the stability condition for LTI systems with impulse response 
g{t)/g\n], suppose we have a bounded input x(t)/x[n] such that 


\x(t)\ < B < oo for all t (1.2.26a) | \x[n]\ < B < oo for all n (1.2.26b) 


Then we can use the input-output relationship (1.2.6)/(1.2.9) of the continuous- 
time/discrete-time LTI system to express the magnitude of the output as 


|y(OI 


(1 = 6) | / x(z}g(t - r)dr| 
< J \x(z)\\g(t ~ z)\dz 


(1.2.26a) r°° 

< Bj \g(t-z)\dz 
— B j°° \gM\dr 


\y[n ]\ (1 = 9) \XZ=-oo X[m] ^ n - m]\ 

< Xir=-oo \ x ^ m ^S[n- m ]\ 

(1.2.26b) „oo 

- B Z^ m= _oo _ 


which means that the output is also bounded. This implies that the system is 
(BIBO) stable if the impulse response g(t)/g[n] is absolutely integrable/ 
summable, i.e., 

/“ \g(0\dz < oo (1.2.27a) | YZ=-oo lglm]l < 00 ( L2 - 27b ) 

In fact, this condition is not only sufficient but also necessary for stability of 
continuous-time/discrete-time systems since if it is not satisfied, we can find a 
bounded input which makes the output unbounded (see Problem 1.5). The following 
remark restates the stability condition in terms of the pole locations of the system 
functions where the poles are the values of s or z at which the denominator of G (s) 
or G[z] becomes zero. 

Remark 1.6 Stability of LTI Systems with System Function G(s)/G[z] 

A continuous-time/discrete-time linear time-invariant (LTI) system having the 
system function G(s) = C{g(t)} / G\z] = Z{g[n]} is stable if and only if all the 
poles of G(s) / G\z\ are strictly within the left-half s -plane/the unit circle in the z 
-plane (see Remarks 2.5, 3.2, 4.5, and Theorem A.l in Appendix A). 
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1.2.9 Causality 

A signal x(t)/x\n] is said to be causal if it is zero for all t < 0 / n < 0. A system is 
said to be causal or non-anticipatory if the response (output) of the system does not 
precede the excitation (input), i.e., the output depends only on the present and past 
values of the input. In other words, the output of a causal system to an input appears 
only while or after the input is applied to the system. The necessary and sufficient 
condition for the system causality is that the impulse response is causal, i.e., 

g(t) = 0 for all t < 0 (1.2.28a) | g[n ] = 0 for all n < 0 (1.2.28b) 

since the impulse response g(t ) / g[n] means the output measured at time t [s]/ n 
[samples] after the impulse signal is applied as an input. 

We can use Eqs. (1.2.6)/(1.2.10) (with Eqs. (1.2.7)/(1.2.11)) to write the time- 
domain input-output relationships of continuous-time/discrete-time causal LTI sys¬ 
tems as 

y(t) = J x(x)g(t-x)dx 
gi '~ r)= c£a ,_t<0 / 8(T)x(t ~ X)dr 

= J x(x)g(t - x)dx + J' x(x)g(t-x)dx\ 

y(t) = y(to) + J' x(x)g(t - x)dx (1.2.29a) 

In fact, all physical systems such as analog filters are causal in the sense that they 
do not react to any input before it is applied to them. As a contraposition, a non- 
causal or anticipatory system is not physically realizable. Causal filters are typically 
employed in applications where the inputs are (on-line) processed as they arrive. An 
example of non-causal system is a digital filter for image processing, which collects 
the input data x[m , n]’s in one frame for some period and processes them at a time 
where m and n are spatial indices. 


yW = Yh m= - 0 o x ^ m ^ n ~ m ! 

g[n—m]=0 for n-m <0 

ca " sal 2^ m= _oo ~ m\ 

= Y nn x[m\g[n - m ] 

+ El =no+1 - "d; 

y[n\ = y[n 0 l + x[m]g[n - m] 

(1.2.29b) 


1.2.10 Invertibility 

A system is said to be invertible if distinct inputs produce distinct outputs. If a 
system G is invertible, then it is possible to design its inverse system H which, 
connected in cascade with G at the output port, receives the output of G to restore 
the input (applied to G) as its output. 

Especially for an LTI system G with the impulse response g(t)/g[n], the impulse 
response h(t)/h[n] of its inverse system H must satisfy the following condition: 
(see Problem 1.6) 
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g{t)*h{t) = <5(1); G{s)H(s) = 1 (1.2.30a) 


g[n]*h[n] = S[n]-, G[z]H[z\ = 1 (1.2.30b) 

(cf.) An example of non-invertible system is a gambler (with a poker face) whose 
face (output) does not vary with his card (input) so that other gamblers cannot 
make the inverse system reading his card from his face. 


1.3 Systems Described by Differential/Difference Equations 

1.3.1 Differential/Difference Equation and System Function 

The time-domain input-output relationships of continuous-time/discrete-time sys¬ 
tems are often described by linear constant-coefficient differential/difference equa¬ 
tions that are set up based on underlying physical laws or design specifications to 
make it perform desired operations: 

y^iV ^ d'yjt) _ ^ d j x(t) 

2-^=o a ' dt‘ ~ ^j=o 1 dt> 

with the initial conditions 

y(to), y'(to), ■■■, y (iV_ 1 ) (to) 


El® 

with the initial conditions 

y[n 0 ], y[n 0 - 1], • • • , y[n 0 — N + 1] 


With zero initial conditions, this can be transformed to make the system or transfer 
function as 


Y . a.iS l Y{s ) 

A(s)Y(sj 

G(s) 


t - yM 

Y. Q bj sJ X(s) 

Y(s) _ B(s) 

XCs) A(,s) 

(1.3.1a) 


El^M-El^™ 

A[z]Y[z ] = B[z]X[z]; 


G[z] = 


Y[z ] 
X[z] 


B[z] 

AM 

(1.3.1b) 


where 


where 


A(s) = Yj. 0 a ' s 1 B(s) = Y / . Q bj sj 




Note the following: 

The poles!zeros of the system function G(s) or G[z] are the values of s or z at 
which its denominator/numerator becomes zero. 
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The degree N of the denominator A(s)/A[z\ of the system function G(i)/G[z] is 
called the order of the system. If N / 0, the system is said to be recursive in the 
sense that its output depends on not only the input but also the previous output; 
otherwise, it is said to be non-recursive or memoryless and its output depends 
only on the input. 

Especially, discrete-time recursive and non-recursive systems are called HR 
(infinite-duration impulse response) and FIR (/inite-duration impulse response) 
systems, respectively since the duration of the impulse response of recursive/non- 
recursive system is infinite/finite, respectively. 


1.3.2 Block Diagrams and Signal Flow Graphs 

Systems are often described by graphical means such as block diagrams or sig¬ 
nal flow graphs. As an example, let us consider an RC circuit or its equivalent 
depicted in Fig. 1.16(a). We can apply Kirchhoff’s current law to write the node 
equation, take its Laplace transform with zero initial conditions, and find the system 
function as 


R 



(bl) Block diagram representation (b2) Block diagram representation 


Vi(s) adder MR l(s) MCs V 0 (s) V;[z] adder MR Hz] c(1 _ z -f) V 0 [z] 


Vl(t) j 

p, 

vM 


kw 

(cl) Signal flow graph representation 

V;{s) adder 1 /R f(s) MG g” 1 v o( s ) 

(c2) Signal flow graph representation 

V,[z] adder TIRC z -i V 0 [z] 

I ? 1 

r 



r 

(dl) State diagram 



(d2) State diagram 



Fig. 1.16 Block diagram, signal flow graph, and state diagram representations of a system 
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dv 0 (t) V 0 (t) Vi(t) 


CsV a (s) + - V 0 (s) = - Vi-(5) G(s) 


Vo(s) = 1 

' V,(s) RCs + 1 


We may replace the derivative dv 0 (t)/dt with its difference approximation 

dv 0 (t) v 0 ((n + 1)T) - v 0 (nT) = v 0 [n + 1] - v 0 [n] 
dt ~ T T 

with sampling interval T to discretize the differential equation into a difference 
equation, take its z -transform with zero initial conditions, and find the system 
function as 


_ v„[n + 1] — v 0 [n] v 0 [n] u,[n] 


Fig. 1.16(bl)/(b2) show the block diagram representing the continuous-time/ 
discrete-time system whose input-output relationship is described by Eqs. (1.3.2a)/ 
(1.3.2b) in the time domain and (1.3.3a)/(1.3.3b) in the s- / z -domain. 
Figure 1.16(cl)/(c2) and (dl)/(d2) show their signal flow graph representations 
where a branch from node j to node i denotes the causal relationship that the 
signal j is multiplied by the branch gain and contributes to the signal i. Espe¬ 
cially, Fig. 1.16(dl) is called a continuous-time state diagram since all branch gains 
are constants or s -1 (denoting an integrator). Likewise, Fig. 1.16(d2) is called a 
discrete-time state diagram since all branch gains are constants or z~ l (denoting a 
delay T ). 

Since signal flow graphs are simpler to deal with than block diagrams, we will 
rather use signal flow graphs than block diagrams. A signal flow graph was origi¬ 
nally introduced by S.J. Mason as a graphical means of describing the cause-effect 
relationship among the variables in a set of linear algebraic equations. It consists of 
nodes connected by line segments called branches. Each node represents a signal 
(variable), whose value is the sum of signals coming along all the branches from 
other nodes and being multiplied by the branch gain. Every branch has the gain and 
direction that determine or are determined by the cause-effect relationship among 
the variables denoted by its nodes. Note that a branch with no gain indicated is 
supposed to have unity gain. 
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For example, we consider the following set of linear equations: 

y 2 = a n yi + a 32 y 3 , ?3 = a 23 y 2 + a 43 y 4 , 

y 4 = a 34 y 3 + a^y 4 + a 54 y 5 , y 5 = a 25 y 2 + a 35 y 3 + a 45 y4 

which describes the cause-effect relationship among the variables yj , y 2 , y 3 , y 4 , 
and ys with the causes/effects in the right/left-hand side, respectively. Figure 1.17 
shows a signal flow graph representing the relationships described by this set of 
equations. 



1.3.3 General Gain Formula - Mason’s Formula 

In this section we introduce Mason’s gain formula, which is applied to signal flow 
graphs to yield the overall gain from an input node to an output node. To understand 
how to use the formula, we need to know the following terms: 

- Input Node (Source): A node having only outgoing branches. 

- Output Node (Sink): A node having only incoming branches. 

(cf.) Note that, in contrast with the input node, the output node may not be clearly 
seen. Suppose we don’t have the dotted branch in the signal flow graph 
depicted in Fig. 1.17. In that case, if we regard ys as an output, we may 
draw a branch with unity gain from the node for ys so that the node appears 
to be an output node. 

- Path: A continuous connection of branches traversed in the same direction. 

- Forward Path: A path connecting an input node to an output node along which 
no node is encountered more than once. 

- Loop: A closed path that originates and terminates at the same node and encoun¬ 
ters no other node more than once. 

- Path Gain: The product of all the branch gains along a path. 

- Loop Gain: The path gain of a loop. 

- Non-touching: Having no nodes in common. 

The gain formula states that the overall gain is 
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y nut 1 y—\V 

G=- = -r , M k A* ( 1 . 3 . 4 ) 

y in A *—'k= 1 

with A = 1 - p m\ + Pm2 _ P "‘3 + ■ ■ ■ ( 1 - 3 . 5 ) 


where 


N : Total number of forward paths from node y ln to node y out 
Mi : : Path gain of the k th forward path 

P mr : Gain product of the m th combination of r nontouching loops 
A k : A (Eq. ( 1 . 3 . 5 )) for the part of the signal flow graph not touching the k th 
forward path 


It may seem to be formidable to use at first glance, but is not so complicated in 
practice since most systems have not so many non-touching loops. For example, we 
can apply Mason’s gain formula to the signal flow graph depicted in Fig. 1.18 as 
follows: 


V, A *—‘k=\ 



# Output 
y 5 node 


N = 3 (the total number of forward paths from node y\ to node >’5) 

M 1 = fli 2 « 23 U 34 « 45 , Ai = 1 for the forward path yi — y2 — yz — yA — ys 
M2 = «i2«23ri35, A2 = 1 — U44 for the forward path yi — y2 — y3 — ys 
M 3 = a 12 a 2 5, A 3 = 1 — (U34U43 + a.44) for the forward path y x - y 2 - y 5 
A — 1 — (a 23 a 32 + 034043 + 044 + 045O54 + 035O54O43 + 025054043032) 
+ (023O32O44 + 023O32O45O54) 


1.3.4 State Diagrams 

Now we introduce a special class of signal flow graphs, called the state diagram or 
state transition signal flow graph, in which every branch has a gain of constant 
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or s -1 (integrator)/^ 1 (delay). This is very useful for the purposes of system 
analysis, design, realization, and implementation. Systems represented by the state 
diagram need the following three basic software operations or hardware elements 
for implementation: 


addition(adder) 
multiplication(amplifier) 
integration(integrator) ,s _1 


- addition 

- multiplication 

- delay (z~ 1 //advance (z) 


It is good enough to take a look at the following examples. 


Example 1.4a Differential Equation and Continuous-Time State Diagram 


Figure 1.19(a) and (b) show the controllable and observable form of state dia¬ 
grams, respectively, both of which represent the following differential equation or 
its Laplace transform (see Problem 1.9): 


y”(t ) + a\y'(t) + a 0 y(t) = b\u(t) + bou(t) with zero initial conditions 

(El ,4a. 1) 


(s 2 + a x s + a 0 )Y(s) = ( b x s + b 0 )U(s ) 


(El.4a. 2) 


Example 1.4b Difference Equation and Discrete-Time State Diagram 

Figure 1.20(a)/(b)/(c)/(d) show the direct I/transposed direct I/direct II/transposed 
direct II form of state diagrams, respectively, all of which represent the following 
difference equation or its z -transform (see Problems 1.8 and/or 8.4): 

y\n + 2] + aiy[n + 1] + aoy[n] = b\u[n + 1] + bou[n] with zero initial conditions 

(E1.4b.l) 

(z 2 + an + a 0 )Y[z\ = ( bpz + b 0 )U[z] (E1.4b.2) 



xi=-a 0 x 2 + b 0 u 

(b) Observable canonical form of state diagram 


Fig. 1.19 State diagrams for a given differential equation y"(t)+aiy'(t)+aoy(t) = biu'(t)+bou(t) 
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Signal distribution point 
Adder(addition) 

Delay 

Amplifier (multiplication) 


Fig. 1.20 State diagrams for a given difference equation y[n + 2] + a\y[n + 1] + aoy[n] = 
b!u[n + 1] + b 0 


For example, we can write the state and output equations for the state diagram of 
Fig. 1.20(c) as 


r*t[n + l]] [ 0 llfjdW] 

|*2 [n + 1]J L-«o -«ij [x2[n]\ 


[?]“ w 


(El.4b. 3) 


y[n ] = bix 2 [n] + b 0 xi[n] 


(E1.4b.4) 


We can apply Eq. (8.3.2b) with Eqs. (1.4b.3,4) or Mason’s gain formula for 
Fig. 1.20(c) to obtain the transfer function G[z] = Y[z]/U[z\ or equivalently, the 
input-output relationship (E1.4b.2). 

The digital filter or controller may be realized either by using a general-purpose 
computer or a special digital hardware designed to perform the required computa¬ 
tions. In the first case, the filter structure represented by the state diagram may be 
thought of as specifying a computational algorithm where the number of z or z -1 is 
proportional to the required memory size. In the latter case, it may be regarded as 
specifying a hardware configuration where z~ l denotes a delay element like a flip- 
flop. Note that, as shown in the above examples, the structure to solve or implement 
a given differential/difference equation is not unique and it can be rearranged or 
modified in a variety of ways without changing the overall input-output relationship 
or system function. 
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1.4 Deconvolution and Correlation 

In this section we will introduce the two terms related with the convolution. One is 
the deconvolution, which is the inverse process of convolution. The other is the cor¬ 
relation, which is procedurally similar to, but totally different from the convolution 
in the physical meaning and usage. 


1.4.1 Discrete-Time Deconvolution 

In Sect. 1.2.3, the input-output relationship of a discrete-time LTI (linear time- 
invariant) system was derived as Eq. (1.2.9): 

y[n] (1 =\[n]*x[n] = ^“ = oo g[n - m]x[m] (1.4.1) 

where x[ri], y[n], and g[ri\ are the input, output, and impulse response of the 
system. Thus, for an FIR (/inite-duration impulse response) system with 

g\ti\ = 0 for \n\ > N, (1.4.2) 

we can write its output to the input {x[m] for m = 0 : N — 1} applied from m = 0 
to N — 1 as 

= Sln-mMm] (1.4.3) 

or in matrix-vector form as 


' y[0] - 

y[ H 


' *[0] 

Ml] 

M-i] 

MO] 

• M-tf+1]' 

. g[-N + 2] 

MO] 

Ml] 

_y[N - 1]_ 


_g[N - 1] 

g[N - 2] 

• MO] _ 

_x[N - 1]_ 


y = Gx with G : transmission matrix (1-4.4) 

One might ask a question, “Can we or how can we find the input sequence x\n] 
for a system characterized by its impulse response g[n] to produce a certain output 
sequence y[n]?”. For the FIR system with the input-output relationship described 
by Eq. (1.4.4), we can find the input sequence as 

x = G _1 y, (1.4.5) 

if the transmission matrix G is nonsingular. Furthermore, if the system is causal, 
i.e., g[n] = 0 for n <0, then the transmission matrix becomes lower-triangular as 
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*[ 0 ] 

gm 
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G = 


0 

*[ 0 ] 


lg[N - 1] g[N - 2] • g[0]J 


(1.4.6) 


so that if g[0] ^ 0, the input sequence can be determined by forward substitution: 


x\n\ = 


yW - YZJpgfr ~m]x[m] 
g[ 0] 


(1.4.7) 


starting from x[0] = }’[0]/g[0] (see Problem 1.11). 

Note that the problem of determining the impulse response g[ri\ for given input 
and output sequences can be dealt with in the same way. 


1.4.2 Continuous/Discrete-Time Correlation 

The cross-correlation between two signals measures how similar the two signals are 
over temporal or spatial difference. The auto-correlation of a signal measures how 
much the signal looks like itself over temporal or spatial difference. Correlation 
is widely used for various purposes including signal detection in communication 
systems. 

Let x(t)/x[n] and y(t)/y[n] be two continuous-time/discrete-time transient or 
finite-duration signals. Then the cross-correlation between them is defined as fol¬ 
lows: 


<Ayv{t) 


/: 

/: 

/: 


x(t + T )y*{t)dt 
x(t)y*(t - r)dt 

x(-t + r)y*(—t)dt 

(1.4.8a) 


=x£_I 

=e:_„ 


x[n + m]y*[n] 
x[ri]y*[n — m ] 


x[-n + m]y*[-n] 
(1.4.8b) 


where z/m, called a lag variable, represents the relative delay (shift) between the 
two signals. If the two signals happen to be identical, i.e., x(t) = y(t)/x\n] = >’[«], 
we have the auto-correlation as 
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<Pxx(j) = 


/: 

/: 

/: 


x(t + z )x*(t)dt 
x(t)x*{t — z)dt 

x(—t + r )x*(—t)dt 

(1.4.9a) 


4>xx[m] - YlZ- 


x[n + m]x*[n] 


= Y,Z-oo Xln]X * [n - m] 

= J2Z-oc X[ ~ n + m]X * [ ~ n] 

(1.4.9b) 


There are some properties of correlation to note: 


<t>xx<j) = <P* xx (-r) 

(1.4.10a) 

4>xyM = <P* yx (-z) 

(1.4.11a) 

4> xy {z) = x(r)*y*(-T) 

(1.4.12a) 


<t>xx[m\ = 4>* xx [-m] (1.4.10b) 

<j> xy [m] — <j>* x [—m] (1.4.11b) 

cf) X y[m\ = x[m]*y*[—m] (1.4.12b) 


If x(t)/x\n] and y(t)/y[n\ are the input and output of a continuous-time/discrete- 
time LTI system so that y(t) = g(t) * x(t)/y\n\ = g[ri\ * x[«], then we have 

4>xy{r) = r(-r)*0,,(T) (1.4.13a) <t> xy [m] =£ g*[-m]*<l> xx [m] (1.4.13b) 

<l>yy(T) = g*(-T)*<j) yx ( t) (1.4.14a) </> yy [m] « g*[-m]*<t> y Am\ (1.4.14b) 

(cf.) If the signals are random or periodic so that nonzero values appear all 
over the time interval, the correlation should be defined as a time-average 
version. 

The correlation functions are very useful for extracting certain signals from noisy 
ones and determining the spectral density of random signals. Look at the following 
remark and example. 

Remark 1.7 Properties of Autocorrelation 

(1) In case two signals are periodic or random, their correlation should be defined as 

1 rT , in 

<t>xy(r) = — / x(t + z)y*{t)dt <t> xy [m\ = w + x Y^ n= . N x[n + m ^y*M 

(1.4.15a) | ( L4 - 15b ) 

(2) The autocorrelation (1.4.9a)/( 1.4.9b) is even and has its maximum at z = 
0/m = 0. In the case of periodic or random signals, the maximum value is 
the mean squared value of the signal. 
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Remark 1.8 Convolution vs. Correlation and Matched Filter 

(1) Equation (1.2.7)/(1.2.11) implies that the continuous-time/discrete-time con¬ 
volution of two time functions/sequences can be obtained by time-reversing 
one of them and time-shifting (sliding) it, multiplying it with the other, and 
then integrating/summing the multiplication. The correlation differs from the 
convolution only in that the time-reversal is not performed. 

(2) If we time-reverse one of two signals and then take the convolution of the time- 
reversed signal and the other one, it will virtually yield the correlation of the 
original two signals since time-reversing the time-reversed signal for comput¬ 
ing the convolution yields the original signal as if it had not been time-reversed. 
This presents the idea of matched filter, which is to determine the correlation 
between the input signal x(t)/x\n\ and a particular signal w(t)/ui[n] based on 
the output of the system with the impulse response g(t) = w(—t)/g[n\ = 
w [—n] to the input x(t)/x[n]. This system having the time-reversed and pos¬ 
sibly delayed version of a particular signal as its impulse response is called the 
matched filter for that signal. Matched filter is used to detect a signal, i.e., to 
determine whether or not the signal arrives and find when it arrives. 

Example 1.5 Correlation and Matched Filter 

Consider the two signal waveforms of duration T = 2 [s], which represent 

0 and 1 and are depicted in Fig. 1.21(al) and (bl), respectively. According to 

Remark 1.8(2), the impulse responses of their matched filters are 



(dl) The output y,(f) of matched filter 1 to the input depicted in (c) 



(d2) The output y 2 (f) of matched filter 2 to the input depicted in (c) 


Fig. 1.21 Two matched filters for two signals and their outputs 


input signal 
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gMmxi(-t) and g 2 {t)=x 2 (-t) (El.5.1) 

We have, however, a problem that these filters are non-causal so that they are not 
physically realizable. A reasonable measure is to shift their impulse responses by 
T = 2 so that they become causal as depicted in Fig. 1.21(a2) and (b2): 

gx(t) = xi(T - t ) and g 2 (t) = x 2 (T - t ) (El.5.2) 

Suppose the input signal depicted in Fig. 1.21(c) is applied to the two matched 
filters with the impulse responses given by (El.5.2). We can compose the following 
MATLAB program “sig01e05.m” to find their outputs and run it to get the results 
shown in Figs. 1.21(dl) and (d2). There are some points to think about: 

- As long as the amplitude of the signals (expected to arrive) are the same, the 
output of each matched filter achieves its maximum 2 s after the corresponding 
signal arrives. Why? 



- If we remove the zero period between the signals and generate a signal every 2 s 
in the input, could we still notice the signal arrival times from (local) maxima of 
the output? (See Problem 1.12(a).) 

Remark 1.9 xcorr () - MATLAB function for Correlation 

(1) The MATLAB function x c o r r (x, y) returns the correlation of two sequences 
x[n] and y[ri\ defined by Eq. (1.4.16). Depending on the third input argument, 
it returns different versions of correlation as follows: 
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xcorr(x,y/coeff') -> 


Pxy[m] = 


Yl™=-oo x[n + m] y*[n] 

(EI^[«]l 2 ElyWI 2 ) 1/2 


(correlation coefficient) 


< P < +1) 
(1.4.16a) 


xcorr(x,y,'biased') —> 

I F E^=o 1_|m| x[n+m] y*[n ] for 0 < m < IV - 1 

F E„=o "" X W y*\- n ~ ™] for — (IV — 1) < m < 0 

(1.4.16b) 


xcorr(x,y,'unbiased') —> 


I W^\m\ Zn^~ m x[n + m] y*[n ] for 0 < m < N - 1 

<P*yW = 

[ N—\m\ £n=o ' x[n]y*[n — m] for — (N — 1) < m < 0 

(1.4.16c) 

(2) If the two sequences are of different lengths, xcorr (x, y) appends one of 
them by zeros to make them have equal lengths and returns their 
convolution. 

(3) The durations of the convolution and correlation of two sequences x[n] (of dura¬ 
tion [n 0j ’.nfjc]) and y[n] (of duration [« (Lv are [n 0r + n 0 _ y :ti f^ + n f y ] 

and [riQjc — n fy : n f __ x — no_ y ], respectively. 


Example 1.6 Correlation for Periodic Signals with Random Noise 

We can use MATLAB function randn (M, N) to generate a zero-mean and unit- 
variance normal (Gaussian) noise sequence in an M x N matrix. Figure 1.22(al) 
and (a2) illustrate a Gaussian 1 x 128 random sequence ui[n] with variance a 2 = 
0.5 2 (generated by 0.5*randn (1, N)) and its autocorrelation <p ww [m] (obtained 
by xcorr (w, w)), respectively. On the other hand. Fig. 1.22(bl) shows a noise- 
contaminated sinusoidal sequence x[n] = sin(jrn/16) + w[n]. Figure 1.22(b2), 
(b3), and (b4) show the various autocorrelations of x[n] that are obtained by 
using xcorr (w,w) , xcorr(w,w, 'coef')/xcorr(w,w, 'biased'), 
and xcorr (w, w, 'unbiased'), respectively. 

Note the following observations: 

- All the autocorrelations in Fig. 1.22(a2), (b2)-(b4) are even and have their max¬ 
ima atm = 0 as stated in Remark 1.7(2). Especially, the maximum of [m] in 
Fig. 1.22(a2) is 
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20 

0 


100 
0 

-100 

(bl) A noise-contaminated sinusoidal wave x[n] (b2) Autocorrelation of x[n] from xcorr() 


0 


(b3) Autocorrelation of x[n] 

from xcorr(x,x, ‘biased’)/xcorr(x,x, ‘coef’) 

Fig. 1.22 Autocorrelation obtained using the MATLAB 

<p ww [0] ~ Expectation ^ x 2 [«] J - Y? n -o ff2 - 128 x °- 52 = 32 

(El.6.1) 

- Marvelously, the noise effect can hardly be found in the autocorrelation except 
for the spike at m — 0. Thanks to the noise reduction effect of autocorrelation, the 
periodicity of the signal can be observed more clearly from the autocorrelation 
than from the original noise-contaminated signal. 

- Figure 1.22(b2) and (b3) show that the autocorrelation obtained from 
xcorr (w, w, 'biased' ) is just a 1 /^-scaled version of that obtained from 
xcorr (w, w). The normalized version obtained from xcorr (w, w, 'coef' ) 
has similar shape. Any of these versions have some end effect, i.e., their magni¬ 
tudes decrease as the time lag m increases not because the correlation or similar¬ 
ity gets loose, but because the number of samples in the summation decreases. 
In contrast, the autocorrelation obtained from xcorr (w, w, 'unbiased' ) is 
relatively free from the end effect as shown in Fig. 1.22(b4). 



-100 -50 0 50 100 

(b4) Autocorrelation of x[n] 
from xcorr(x,x, ‘unbiased’) 


function xcorr () 




0 


(al) A (Gaussian) noise sequence w[n] 


%sig01e06.m : Autocorrelation of a noise-contaminated periodic signal 

N=128; W=pi/16; nn=0:N-l; 

s= sin(W*nn); w= 0.5*randn(1,N); x=s+w; 

subplot(321 ), plot(nn,w) 

[phi_w,mlag]=xcorr(w,w); % Autocorrelation of the noise 
subplot(322), plot(mlag,phi_w) 
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subplot (323) , plot (nb f 5f> nn, s,'k') 

[phi_x,inl.ag] =xoorr (x, x) ; % AutocOKrelation of the corrupted signal 
subplot (324) , plot (mlag,phi_x) 

[phi_x_coef,mlag]=xcorr (x,x, ' coef' ) ; % Correlation coefficient 
subplot (325) , plot (mlag/phitHEviPbef) 

[phi_x_biased,mlag] =xcorr (x, x,'biased') ; % Biased autocorrelation 
hold on, plot (mlag, phi_xlbiased,' r ) 

[phi_x_unbiased, mlag] =xcorr (x, x,' unbiased') ; % Unbiased autocorrelation, 
subplot (326) , plot (mlag^MLxjjnbiased), axial [mlag ([1 end]) -1 1]) 


1.5 Summary 

In this chapter we have introduced some basic continuous-time/discrete-time signals 
and defined a number of important concepts related to systems such as linearity, 
time-invariance, causality, stability, impulse response, and system (transfer) func¬ 
tion. We have also derived the convolution form of input-output relationship of LTI 
systems. We have also indicated that a continuous-time/discrete-time system can be 
described analytically by differential/difference equations and pictorially by signal 
flow graphs. Finally, we introduced the concept of correlation. 


Problems 


1.1 Representation of Unit Impulse Function by Sine Function 

(a) Referring to the web site <http://mathworld.wolfram.com/SincFunction. 
html> or [K-l] (Sect. 15.4, Example 2) or Eq. (E2.3.3) of this book, show 
that the sine function representation (1.1.33a) of the unit impulse function 
S(t ) satisfies the property (1.1.19) regardless of D or w: 

[ “= l r dx = 1 (P1 ' U) 


(b) Plot the sine function 


sin (nt/D) 


(PI.1.2) 


against time t for D — 1, 0.5, 0.25, and 0.125 and check the following: 

- It is an even function since both of the numerator and denominator 
functions are odd ones. 

- Its amplitude decreases as [t | increases since the magnitude of the 
denominator increases while the amplitude of the numerator is constant. 

- It becomes zero at t — mD(m / 0) and \ / D at t — 0 since 
lim sinc(x) = 1. 
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1.2 Convolution 

Consider the two continuous-time signals x(t) = r^it) = u s (t) — u s (t — 3) and 
g(t) = e~°- 5t u s (t). 

(a) Show that the (continuous-time) convolution of these two signals is 


0 


for t < 0 


x(t)*g(t) = 


2(1 - e~ 05t ) 

2(e -0.56-3) _ e -0.5 f) _ 2(gtS _ 1)e -0.5, 


for 0 < t < 3 
for t > 3 


(PI.2.1) 

(b) As in Example 1.2, we can use the MATLAB function ‘conv ()’ to com¬ 
pute this continuous-time convolution approximately. Compose a program 
which samples the two signals at t = nT s (T s = 0.1 [s]), use ‘conv ()’ to 
compute the convolution, and plot it together with the true convolution 
(PI.2.1) for t = [0, 10]s. Run it to see if the approximate convolu¬ 
tion is close to the true one. If we decrease the sampling period, say, to 
T s = 0.01 s, is it helpful? 


1.3 Necessary Condition on BIBO (Bounded Input Bounded Output) Stability 
In Sect. 1.2.8 it was shown that the absolute integrability/summability 
(1.2.27a)/( 1.2.27b) of impulse response guarantees the BIBO stability and thus 
are sufficient conditions. Here, you can show that if the conditions do not hold, 
there is a bounded input yielding unbounded output, which implies that they 
are also necessary conditions for BIBO stability. To this end, suppose that the 
impulse response of a system does not satisfy the condition (1.2.27a)/(l. 2.27b): 


J \g(j)\dx = oo 
EL. \s[m]\ = oo 


(a) Consider the following signal: 

1 0 for t such that g(—t) = 0 
for t such that g(-t) + 0 

1 0 for n such that g[—ri] = 0 
f° r n suc h that g[—n] ± 0 


(PI.3.la) 
(PI.3.lb) 


(PI.3.2a) 


(PI. 3.2b) 


Are these signals bounded? If they are bounded, what is their upperbound? 
(b) Show that the output y(t)/y[n] to the (bounded) input x(n)/x\n] at t = 
0/n = 0 is unbounded, implying that the system is not BIBO stable. 

1.4 Stability of Continuous-Time Systems 

Remark 1.6 states that a continuous-time LTI system is stable if and only if its 
system function G(s) = C{g(t)\ has all the poles strictly within the left-half s 
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-plane or equivalently, the real parts of all the poles are negative. Referring to 
the remark, consider the following two systems: 


G a (s) = 


2 

(i + l)(i+2) 


(P1.4.1a) 


G b (s) = 


6 

(s-lXs+2) 


(P1.4.1b) 


(a) Find the impulse responses g a (t) and g b (t) by taking the inverse Laplace 
transform of each system function. Check if each system satisfies the 
stability condition (1.2.27a) or not. 

(b) Find the poles of each system function and determine whether or not each 
system satisfies the stability condition stated in Remark 1.6. Does the result 
agree to that obtained in (a)? 

(c) Find the step responses of the two systems, i.e., their outputs to a unit-step 
input x(t) = u s (t ) whose Laplace transform is X(s) — 1/s. Check if each 
step response converges or not. 

(cf.) You might get y a (t) by typing the following commands into the MAT- 
LAB command window: 

>> syms s; Gas=2/(s+l)/(s+2); Xs=1/s; 

Yas=Gas*Xs, yat=ilaplace(Yas) 


1.5 Stability of Discrete-Time Systems 

Remark 1.6 states that a discrete-time LTI System is stable if and only if its 
system function G[z] = Z{g\n]} has all the poles strictly within the unit circle 
(see Remark 4.5). Referring to the remark, consider the following two systems: 


(z - 0.5)(z + 0.5) 


(P1.5.1a) 


G b [z] 


(z — 1.5)(z — 0.5) 


(P1.5.1b) 


(a) Find the impulse responses g a \_n\ and gb\ri\ by taking the inverse z - 
transform of each system function. Determine whether each system satisfies 
the stability condition (1.2.27b) or not. 

(b) Find the poles of each system function and determine whether or not each 
system satisfies the stability condition stated in Remark 1.6. Does the result 
agree to that obtained in (a)? 

(c) Find the step responses of the two systems to a unit-step input x[ri] = u s [n ] 
whose z -transform is X[z] = z/(z — 1). Determine whether each step 
response converges or not. 

(cf.) You might get y a [n] by typing the following commands into the MAT- 
LAB command window: 

>> syms z; Gaz=3*z/(z—0.5)/(z+0.5); Xz=z/(z—1); 

Yaz=Gaz*Xz, yan=iztrans(Yaz) 



1 Signals and Systems 


1.6 Inverse System 

Consider a model for echo generation, which is depicted in Fig. PI.6(a). 

(a) Noting that the time-domain input-output relationship is 

y(t) = a y{t - T) + x(t) (Pl.6.1) 

show that the impulse response is 

g(t) = ^ a k 8(t — kT) with 0 < a < 1 (Pl.6.2) 

Also find the system function G(s) by taking the Laplace transform of this 
impulse response or the time-domain input-output relationship. Referring 
to Eq. (1.2.27a) or Remark 1.6, determine the stability condition of the 
model system. 

(b) Use Eq. (1.2.30a) to find the system function H(s) of the inverse system. 
Show that the inverse system can be modeled as Fig. PI.6(b), whose time- 
domain input-output relationship is 

x(t) = yit) - a y(t - T) (PI.6.3) 


1.7 Inverse System 

Consider a discrete-time model for duo-binary signaling, which is depicted in 
Fig. PI.7(a). 

(a) Noting that the time-domain input-output relationship is 

y[n\ = x[n] + x\n- 1] (Pl.7.1) 

find the system function G[z] by taking its z -transform. 


y(t) = ay(t-T) + x(f) x(t) = y(t)-ay(t-T) 



(a) A model for echoing (b) A model for removing the echo 


Fig. P1.6 


y[n] = x[ri\ + x[n-1 ] x[n]=-x[n-1 ]+y[n] 



(a) A model for duo-binary signaling (b) A model for detecting system 


Fig. P1.7 
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(b) Use Eq. (1.2.30b) to find the system function H[z] of the inverse system. 
Show that the inverse system can be modeled as Fig. PI.7(b), whose time- 
domain input-output relationship is 

x\n] — —x[n — 1] + y\n\ (PI.7.2) 

1.8 Simulation of Continuous-Time/Discrete-Time System Using MATLAB and 
Simulink 

(a) Find the system function of the system described by the block diagram in 
Fig. 1.16(bl) or the signal flow graph in Fig. 1.16(d) or (dl) with RC = 1. 
Referring to the upper part of Fig. PI.8(a) and the parameter setting dialog 
boxes in Fig. P1.8(bl), (b2), and (b3), perform the Simulink simulation to 
plot the output signal v 0 (t) for 0 <t < 4 s. 




Fig. P1.8 
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(b) Find the system function of the system described by the block diagram in 
Fig. 1.16(b2) or the signal flow graph in Fig. 1.16(c2) or (d2) with RC = 1. 
Referring to the lower part of Fig. PI.8(a) and the parameter setting dialog 
boxes in Fig. P1.8(bl), (b2), and (b4), perform the Simulink simulation 
with sampling interval T = 0.1 to plot v a (t) for 0 < t < 4 s. Also referring 
to the following program “sig01p_08b.m”, perform the MATLAB simula¬ 
tion to plot v a (t) for 0 < f < 4 s. Does decreasing the sampling interval to, 
say, T =0.01 make the output close to that of the continuous-time system 
obtained in (a)? 

(cf.) If you parameterize a constant such as T in the Simulink block diagram 
so that it can be easily changed, you can set it to a new value in the 
MATLAB command window. 



1.9 Continuous-Time State Diagram, State Equation, Transfer Function, and 
Input-Output Relationship 

We can write the state equation for a continuous-time state diagram by taking 
the following procedure. 


1. Assign a state variable x, (t) to the output of each integrator s -1 . 

2. Express the input xf(t) of each integrator s -1 in terms of the state 
variables and system input(s). 

3. Express each output in terms of the state variables and input(s). 










Problems 


(a) Show that we can apply the above procedure to the state diagram of 
Fig. 1.19(a) and write the state equation together with the output equa¬ 
tion as 



y(O = [l>0 ».][*$] (Pl.9.2) 

We can also substitute the output equation (Pl.9.2) into the left-hand side 
of Eq. (E1.4a.l) and use the state equation (PI.9.1) to get the right-hand 
side of Eq. (E1.4a.l): 

y"(t) + a\y'(t) + a 0 y(t) = biu\t) + b 0 u(t ) (Pl.9.3) 


(b) Show that we can apply the above procedure to the state diagram of 
Fig. 1.19(b) and write the state equation together with the output equa¬ 
tion as 


tool ro -«.i fowl M 
U"ij p -01J L''. 
r F»wl 

^ [o i] U 


(PI.9.4) 


(PI.9.5) 


We can also combine these state and output equations to get the input- 
output relationship (E1.4a.l). 

(c) Apply Eq. (8.3.2a) with Eqs. (PI.9.1,2) or (Pl.9.4,5) to find the transfer 
function G(s) = Y(s)/U(s) or equivalently, the input-output relation¬ 
ship (E1.4a.2). Also apply Mason’s gain formula for Fig. 1.19(a) or (b) 
to find G(s). 

(d) With uq = 2, a\ — 3, bo = 4, and b\ — 3, use the MATLAB func¬ 
tion ss2tf () to find the transfer function G(s) of the system described 
by Eqs. (Pl.9.1,2) or (Pl.9.4,5). Reversely, use the MATLAB function 
t f 2 s s () to find a state equation for the transfer function 


_ bis + b 0 _ 3s + 4 
s 2 + a\s + ao s 2 + 3s + 2 


(PI.9.6) 


Which one does it yield, the equivalent of Eq. (Pl.9.1,2) or (Pl.9.4,5)? 

(e) Referring to the following program “sigOlp 09.m”, simulate the systems 
described by Eqs. (Pl.9.1,2) and (Pl.9.4,5) with ao = 2, a\ = 3, bo = 4, 
and bi = 3 to find their outputs (v(f)’s) to an input u(t) = sin(2t) for 
0 < t < 10 s (with sampling interval T = 0.01 s). Do the state equations 
conform to each other in terms of the input-output relationship? 
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(f) Referring to Fig. PI.9, perform the Simulink simulation for the systems 
described by Eqs. (PI.9.1,2), (PI.9.4,5), and (PI.9.6) to find their outputs 
(y(t)’s) to an input u(t) = sin(2t) for 0 < t < 10 s. Do the simulation 
results agree with each other and also with those obtained in (e)? 



Fig. P1.9 Simulink block diagram for Problem 1.9(e) 
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1.10 Discrete-Time State Diagram, State Equation, Transfer Function, and Input- 
Output Relationship 

We can write the state equation for a discrete-time state diagram by taking the 
following procedure. 

1. Assign a state variable x, [n] to the output of each delay element z _1 . 

2. Express the input x, [n + 1] of each delay element z -1 in terms of the 
state variables and system input(s). 

3. Express each output in terms of the state variables and input(s). 


(a) Show that we can apply the above procedure to the state diagram of 
Fig. 1.20(c) and write the state equation together with the output equa¬ 
tion as 


x\[n + 1] _ 0 1 1 pci[n] + b 0 

x 2 [n + 1]J l-ao — «ij L^Wj [bi_ 



u[n] 


(PI.10.1) 

(PI. 10.2) 


We can also substitute the output equation (PI. 10.2) into the left-hand side 
of Eq. (E1.4b.l) and use the state equation (PI.10.1) to get the right-hand 
side of Eq. (E1.4b.l): 


y[n + 2] + aiy[n + 1] + a 0 y[n] = biu[n + 1] + b 0 u[n] (PI.10.3) 

(b) Show that we can apply the above procedure to the state diagram of 
Fig. 1.20(b) and write the state equation together with the output equa¬ 
tion as 



(PI. 10.4) 
(PI. 10.5) 


We can also combine these state and output equations to get the input- 
output relationship (E1.4b.l). 

(c) Apply Eq. (8.3.2b) with Eqs. (PI.10.1,2) or (PI.10.4,5) to find the transfer 
function G[z] — Y\z\/U\z\ or equivalently, the input-output relationship 
(E1.4b.2). Also apply Mason’s gain formula for Fig. 1.20(a), (b), (c), or (d) 
to find G[z\. 

(d) Referring to the following program “sig01p_10.m” or Fig. PI. 10, simulate 
the systems described by Eqs. (PI.10.1,2) and (PI.10.4,5) with ao = 1/8, 
a\ = 3/4, bo = 2, and b\ = \ to find their outputs (y(t)’s) to an input 
u(t) = sin(2?) for 0 < t < 10 s (with sampling interval T = 0.01s). 
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Do the state equations conform to each other in terms of the input-output 
relationship? 




Fig. P1.10 Simulink block diagram for Problem 1.10(d) 


1.11 Deconvolution 

(a) We can make two discrete-time sequences as 

n = 0 1 • • ■ 9 10 11 • • ■ 19 20 21 • • • 29 30 31 • • • 39 

x[n]= 1 1 • • • 1 9 9 ■ 9 -6-6 -6 2 2 • • • 2 

g\n] = 11-11 1 ■ ■ ■ 1 1 1 • ■ ■ 1 0 0 • • • 0 


Compute their convolution y[n] = x[n] * g[n] and plot it. 

(b) Referring to the following MATLAB program “sigOlp ll.m”, compute 
the estimate x[ri\ of x[ri\ from y[ri\ and g[n] two times, once by using 
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Eq. (1.4.5) and once by using Eq. (1.4.7). Compare the two results in terms 
of how close they are to the original input sequence x[ri]. 


%sig01J>,ll .m 
',ciea;.r, clil’: 

x=[ones(1,30) zeros(1,10)]; Nx=length(x); 
g=ones(10,1)*[1 9 -6 2]; g=g(:).'; Ng=length(g); 
n=0:Nx+Ng-2; 
y=conv(x,g); 

subplot(313), stem(n,y,'.') 

% Deconvolution 
fbr m=l:Ng 

for n=l: m, G (m, n) =g (m-n+l) ; end % Eq. (1.4.5) 

xO=(G~-l*y(l:Ng)')'; 
xl(1)=y(1)/g(1); 
fOr n=2:Nx 

xl (n) =y (n) ; 

for m=l:n-1, xl(n)=xl(n)-g(n-m+1)*xl(m); end % Eq. (1.4.7) 
xl (n) =xl (n) /g (1) ; 

err0=norm(xO-x) 
errl=norm(xl-x) 


(cf.) Another way to compute deconvolution is to use the MATLAB command 

x=deconv (y, g). 

1.12 Correlation and Matched Filter for Signal Detection 

Consider Example 1.5 and the related program “sig01e05.m” again. 

(a) To see the transmitted signal x, insert the following statement and run the 
program to check if you can get the results as depicted in Fig. 1.21(c), (dl), 
and (d2). 

subplot( 311 ), plot(tt,xbuffer) 

(b) Remove the zero periods between the signals in the input. Can you still 
notice the corresponding signal arrival times from (local) maxima of the 
output of each matched filter? To simulate this situation, modify the state¬ 
ment for generating the transmitted signal as follows: 

x= [xl x2 xl x2 x2]; 

(c) If we sample the matched filter outputs every 2 s, can we use the sampled 
output to detect the signal successfully based on which filter output is the 
maximum? To simulate this situation, insert the following statements into 
the last part of the for loop: 

fprintf('At t=%5.2f, Matched d«tput=%5.2f %5.2f\n', n*Ts,y); 
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(d) If the input is contaminated with a Gaussian noise with zero mean and 
variance of a 2 = 0.3 2 , will the detection performance be harmed severely? 
To simulate this situation, modify one of the statements in the for loop as 
follows: 

xbuffer= [x(n)+0.3*randn xbuffer(1:end-1)]; 

(cf.) The system with impulse response g,(t) = x,(T — t) is called the 
‘matched filter’ for the signal x t (t) because it is tuned to x,(t) so that 
it can produce the maximum output to the input x, (t). 

1.13 Walsh Functions [W-3] and Matched Filter 



(a) (b) 

Fig. P1.13 


_/ 1 2 _ _J 


With the program “sig01e05.m” modified in Problem 1.12, answer the 
following questions. 

(a) If we use the signal waveform of Fig. PI. 13(a) in place of that of Fig. 1.21(al), 
how are the matched filter outputs sampled every 2 s changed? Can you 
explain why the output of a matched filter is not close to zero 2 s after 
another signal arrives in contrast with the case where the signal waveforms 
of Fig. 1.21(al) and (bl) are used? 

(cf.) This gives us a chance to think about how we can design the signal 
waveforms in such a way the difference between the (sampled) out¬ 
put of a matched filter to the input for which it is tuned and the (sam¬ 
pled) output to other input signals can be maximized, for the purpose 
of minimizing the suffer from possible noise/distortion/interference 
in a communication system. It is desirable to have the signal wave¬ 
forms orthogonal to each other so that the integrations of their 
products are zero. 

(b) Consider the three signal waveforms x\(t), x-i(t), and X3(t) of duration T — 

2 [s], known as Walsh functions, which are depicted in Fig. PI.13(b), (c), 
and (d) and represent a, b, and c, respectively. 

- Are the three signals orthonormal in the following sense? 


[ T n u)x l w, = m-n = \' f ri = { 

Jo [0 for i j 


(PI.13.1) 
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- Modify the program “sig01e05.m” to simulate the situation that the 
following input signal is applied to the three matched filters with the 
impulse response g t (t) = x,(T - t ): 

x{t) = [jci(0 x z (t - T) x 3 (t - 2 T) x 2 (t - 3 T) xi(f - AT)] (Pl.13.2) 

Does the receiver detect the received signals successfully from the sam¬ 
pled outputs of the matched filters for all the zero-mean Gaussian noise 
of variance a 1 = 0.3 2 ? 

1.14 Correlation Function and Radar (Radio Detection and Ranging) System 
(Problem 3.28(e) of [0-1]) 

A radar transmits a short pulse of radio signal (electromagnetic radiation) and 
measures the time it takes for the reflection to return from the target. The 
distance is one-half the product of the round trip time and the speed of the 
signal [W-l], 


Fig. P1.14 




(a) Let the transmitted pulse be pit) and the received pulse a p(t —1\) where t\ 
is the round trip time. Show that their crosscorrelation <t> xp (t) is maximized 
at t — t \: 

0 (; ,( ?1 )= Max </> (7 ,(t) (PI.14.1) 

where 

4 >x P (t) = J x(t + T)p(z)dz = a J p{t - h + z)p{z)dz (PI.14.2) 

<Hint> To find the time at which the crosscorrelation is maximized, use 
the Cauchy-Schwartz inequality: 

J\(z)v(z)dz < ^J\ 2 (z)dz^j ^J\ 2 (z)dz^j (PI.14.3) 

where the equality holds if and only if u(z) = viz). 

(b) Since the radar looks for the peak of the correlation function to find the 
arrival time of returning signal, it would be good to use a pulse signal 
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1 —sig[n] = r[n] _ 

(2) win_power[n] = r 2 [n] 


i_corr[n] = win_sig[n] w 

til -W] n 


Windowed_corr 


V wi n_energy[n] wi n_energy[n-N_FFT] 
Fig. P1.15 Windows to detect an OFDM symbol using correlation 


p(t ) that has a sharply peaked autocorrelation function against possible 
distortion in the returning signal. Which of the two pulses in Fig. PI. 14 is 
better? 

1.15 OFDM Symbol Timing Using Correlation 

Suppose an OFDM (Orthogonal Frequency Division Multiplexing) commu¬ 
nication system in which an OFDM symbol consists of N FFT (Fast Fourier 
Transform) points and N_GI = 16 prefix points where the cyclic prefix is a 
repeat of the end of the symbol at the beginning. Let us consider a problem 
of detecting the start time of each OFDM symbol by using the correlation 
between the prefix and the end part of the symbol. Since we cannot store 
uncountably many samples of the received signal r[n], we use several win¬ 
dows (buffers) to store some duration of signal samples, powers, energies, and 
correlations as shown in Fig. PI. 15 where the contents of each window is as 
follows: 

(1) win_sig[n] = r[n] with the size of at least N_FFT + 1 

(2) win power[n] = r[n] 2 with the size ofN GI + 1 

(3) win energy[n] = X!m=n-N gi+i win_power[m] with the size ofN FFT + 1 

(4) win_corr[n] = r[n]r[n — NJFFT] with the size of N_GI + 1 
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At each iteration when a sampled signal arrives, we compute the normalized 
and windowed correlation 

windowed_corr[n] ? „ 

correlation[n] = - > Threshold(0.99) 

> /win_energy[n]win_energy[n — N_FFT] 

(PI.15.1) 

with windowed corr[n] = ^ ^ ^ win corr[m] 

to determine whether the current sample is the end of an OFDM symbol or 
not. If the normalized correlation is found to exceed the threshold value, say, 
0.99, we set the start time of the detected symbol to N_SD (one OFDM sym¬ 
bol duration) samples before the detection time. Complete the above program 
“detect_OFDM_symbol_with_correlation.m” so that it implements this OFDM 
symbol timing scheme. Also run it to check if it works. 
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Since the great contribution and revolutionary discovery of Jean Baptiste Joseph 
Fourier saw the light in 1822 after passing through the long dark tunnel of J.L. 
Lagrange’s stubborn objection and was supported by P.L. Dirichlet’s rigorous math¬ 
ematical proof in 1829, the Fourier series and transform techniques have played very 
significant role in so many disciplines within the fields of mathematics, science, and 
engineering. 

Joseph Fourier (1768~ 1830) was a French mathematician and physicist who ini¬ 
tiated the investigation of Fourier series and its application. Born as a son of a tailor, 
he was orphaned at age 8. In 1784, at only 16 years of age, he became a mathematics 
teacher at the Ecole Royale Militaire of Auxerre, debarred from entering the army 
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on account of his obscurity and poverty. In 1795, Fourier took a faculty position 
at the Ecole Normale (Polytechnique) in Paris, which is an elite institution train¬ 
ing high school teachers, university professors, and researchers. In 1798, he joined 
Napoleon’s army in its expedition to Egypt as scientific advisor to help establish 
educational facilities there and carry out archaeological explorations. 

Eluding the Nelson’s British fleet, the Napoleon’s Egyption expedition fleet of 
300 ships, 30,000 infantry, 2,800 cavalry, and 1,000 cannons started Toulon on 
May 19,1798, sailing for Alexandria. The great expedition plan plotted by Napoleon 
attached a library with lots of books, many measurement instruments, various lab¬ 
oratory apparatuses, and about 500 civilians to the army; 150 of them were artists, 
scientists, scholars, engineers, and technicians. These human and physical resources 
formed the Institut d‘Egypte in Cairo after Egypt was conquered by Napoleon. 
Napoleon Bonaparte (1769~1821) not yet 30 years old, a great hero in the human 
history, and Joseph Fourier, a great scholar of about the same age in their youth were 
on board the flagship L’Orient of the expedition fleet. What were they thinking of 
when walking around on the deck and looking up the stars twinkling in the sky above 
the Mediterranean Sea at several nights in May of 1798? One might have dreamed 
of Julius Caesar, who conquered Egypt about 1,800 years ago, falling in love with 
the Queen Cleopatra, or might have paid a tribute to the monumental achievements 
of the great king Alexander, who conquered one third of the earth, opening the road 
between the West and the Orient. The other might have refreshed his memory on 
what he wrote in his diary on his 21st birthday. Yesterday was my 21 st birthday, 
at that age Newton and Pascal had already acquired many claims to immortality, 
arranging his ideas on Fourier series and heat diffusion or recollecting his political 
ideology which had swept him and made him get very close to guillotine in the 
vortex of French Revolution. 


2.1 Continuous-Time Fourier Series (CTFS) 
of Periodic Signals 

2.1.1 Definition and Convergence Conditions 
of CTFS Representation 

Let a function x(t) be periodic with period P in t, that is, 

x{t) = x{t + P ) V t (2.1.1) 

where P [s] and ooq = 2jt/P [rad/s] are referred to as the fundamental period 
and fundamental {angular) frequency, respectively, if P is the smallest positive real 
number to satisfy Eq. (2.1.1) for periodicity. Suppose x{t) satisfies at least one of 
the following conditions A and B: 
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< Condition A > 

(Al) The periodic function x(t) is square-integrable over the period P, i.e., 

J \x(t)\ 2 dt<oo (2.1.2a) 

where f p means the integration over any interval of length P. This implies 
that the signal described by x(t) has finite power. 

< Condition B : Dirichlet condition > 

(Bl) The periodic function x(t) has only a finite number of extrema and disconti¬ 
nuities in any one period. 

(B2) These extrema are finite. 

(B3) The periodic function x(t) is absolutely-integrable over the period P, i.e., 

J \x{t)\ dt < oo (2.1.2b) 

Then the periodic function x(t) can be represented by the following forms of 
continuous-time Fourier series (CTFS), each of which is called the Fourier series 
representation: 

< Trigonometric form > 

x(t) = ao + i Uk cos + T. k ! sin kcoot (2.1.3a) 

with coq = (P : the period of x(t)) 

where the Fourier coefficients ao, a k , and b k are 

ao — — f x{t) dt (the integral over one period P) 

P Jp 

a k = — f x(t) cos kco 0 t dt (2.1.3b) 

P Jp 

2 f 

b k — — / x{t) sin kcoot dt 

P Jp 

<Magnitude-and-Phase form > 

x{t) = d 0 + y„ | d k cos(kco 0 t + (p k ) (2.1.4a) 

where the Fourier coefficients are 

do = ao, d k = yja\ + bf, <j> k = tan _1 (— bjjaf) (2.1.4b) 
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<Complex Exponential form> 

m= ] p J2t^ Ckejkmt 

where the Fourier coefficients are 


Ck = 


L 


x(t) e ' k " >nt dt (the integral over one period P) 


(2.1.5a) 


(2.1.5b) 


Here, the k th frequency kco o (|£| > 1) with fundamental frequency coo = 2jt/P — 
2jrfo [rad/s] (P: period) is referred to as the k th harmonic. The above three forms of 
Fourier series representation are equivalent and their Fourier coefficients are related 
with each other as follows: 


co = / x(t)dt = Pd 0 = Pa 0 (2.1.6a) 

k = J x(t) e~ jko)0 ‘ dt — J x(t) (cos kcoot — j sinfccuot) dt 

- y( a k - jb k ) = y dkZfa (2.1.6b) 

k = J x(t) e ikwot dt = J x(t) (cos kcoot + j sin£«oO dt 

p p 

(2.1.6c) 

2Re{c*} u _ C— k - c k _ 2I m{c^} 

P 

(2.1.6d) 


a o = —. a k = - 


b k = - 


jP 


The plot of Fourier coefficients (2.1,4b) or (2.1,5b) against frequency kcoo is referred 
to as the spectrum. It can be used to describe the spectral contents of a signal, 
i.e., depict what frequency components are contained in the signal and how they 
are distributed over the low/medium/high frequency range. We will mainly use 
Eqs. (2.1.5a) and (2.1.5b) for spectral analysis. 

<Proof of the Complex Exponential Fourier Analysis Formula (2.1.5b)> 

To show the validity of Eq. (2.1.5b), we substitute the Fourier synthesis formula 
(2.1.5a) with the (dummy) summation index k replaced by n into Eq. (2.1.5b) as 

c k = J ^^2 c n e jnroo> e~ jkwot dt = ^2 C " ~P f dt *==' c k 

(2.1.7) 
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This equality holds since 


I f P/2 

P J-PI 2 


e j(n-k)ft dt 


for n * k 

T J-r/2 dt = 1 for n = k 


( 2 . 1 . 8 ) 


2.1.2 Examples of CTFS Representation 

Example 2.1 Fourier Spectra of a Rectangular (Square) Wave and a Triangular 
Wave 

(a) CTFS Spectrum of a Rectangular (Square) Wave (Fig. 2.1(al)) 

Consider an even rectangular wave x(t) with height A, duration D, and 
period P : 

x(t) = Ar D/P (t) (E2.1.1) 


, [ 1 for |r - mP | < D/2(m : an integer) 

where r D/P (t ) = 

0 elsewhere 


A 

nr 

i r 

X 


s ; -d/ 2 i 

D/2 

1 L-J 

p ! 


(al) A rectangular wave Ar 0/P (t ): even 



(bl) A triangular wave A\ D/P (f): even 
Fig. 2.1 Rectangular waves and triangular waves 


— A ~ 



-P -D 

.j L.J 

Q. -, 

Q .-- 1 
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(a2) A rectangular wave Ar D/P (t-D/2): odd 



(b2) A triangular wave A\ D/P ( t-D ): odd 



2 Continuous-Time Fourier Analysis 
We use Eq. (2.1.5b) to obtain the Fourier coefficients as 

[PI 2 [Dl 2 A 10/2 

c k = A r D/p (t) e~ jka,ot dt — A / e ikr0al dt = — - e~ jko>at 

J-P/2 J —0/2 —jka>0 \—D/2 

_ A ei k0, ° D ' 2 - e - jk0J <> D/2 _ AD sm(kco 0 D/2) 

jkcoo kwoD/2 


— AD sine I k — ) with coo = — 


Now we can use Eq. (2.1.5a) to write the Fourier series representation of the 
rectangular wave as 


Ar D/P (tf= a) i J2Z-oo AD Sinc { k 7>) eJkm ' 

AD ^oo 2 AD sin (knD/P) 

— -h >-COS ktont 

P i P kitD/P 0 


(E2.1.3) 


In the case of D — 1 and P = 2D = 2 as depicted in Fig. 2.2(al), the 
(magnitude) spectrum is plotted in Fig. 2.2(bl). 

(Q) What about the case of P — D, which corresponds to a constant DC (Direct 
Current) signal? 


A= 1 h 
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(al) A rectangular wave (bl) The magnitude spectrum 



(a2) A triangular wave (b2) The magnitude spectrum 


Fig. 2.2 Rectangular/triangular waves and their CTFS magnitude spectra 
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(b) CTFS Spectrum of a Triangular Wave (Fig. 2.1(bl)) 

Consider an even triangular wave x(t ) with maximum height A, duration 2D, 
and period P: 


x(t) = AX D/P (t) 


(E2.1.4) 


where X D /p(t) = 


jl -t/D 

1 ° 


for \ t — mP\ < D (m : an integer) 
elsewhere 


We use Eq. (2.1.5b) to obtain the Fourier coefficients 


® = I-L A (‘ “ n ) e ~ ,k "" * = L A (‘ “ d ) cos( *"°' ) * 

= 2 [ a( 1 —— \ cos(kcoot) dt = 2A (\ —sin(Xw 0 f)l 
Jo V DJ \ DJ kco o | 0 

“ 1 2A ("s) i cos^rij, 

1 - cos(X« 0 £>) 4 sin 2 (X« 0 T)/2) 

= 2AD---= AD--— 

(IccoqD) 2 (IccoqD/I) 2 

— AD sin c 2 ^k^j with <y 0 = ^ (E2.1.5) 


Now we can use Eq. (2.1.5a) to write the Fourier series representation of the 
triangular wave as 


Ak D /p(f) (2 = a> 2 AD sinc2 ( fe ^) e,k " X)t (E2.1.6) 

In the case of D — 1 and P = 2D = 2 as depicted in Fig. 2.2(a2), the 
corresponding (magnitude) spectrum is plotted in Fig. 2.2(b2). 

(c) MATLAB program to get the Fourier spectra 

Once you have defined and saved a periodic function as an M-file, you can use 
the MATLAB routine “CTFS .exponential ()” to find its complex exponential 
Fourier series coefficients (c^’s). Interested readers are invited to run the follow¬ 
ing program “cir02e01 .m” to get the Fourier coefficients and plot the spectra for 
a rectangular wave and a triangular wave as in Fig. 2.2. 
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Fig. 2.3 Examples of the approximate Fourier reconstruction tor a rectangular pulse 

At this point, you may wonder how a rectangular wave with discontinuities can 
be represented by the sum of trigonometric or complex exponential functions that 
are continuous for all t. To satisfy your curiosity, let us consider the approximate 
Fourier series reconstruction formula. 

x N (t)= | Yf k= _ N c * eikmt ( 2 - L9 > 

This can be used to reconstruct the original time function x(t) from its Fourier 
series coefficients. We can use the above MATLAB program ‘sig02_01.m’ to plot 
the Fourier series reconstructions of a rectangular wave with increasing number of 
terms N = 1, 3, 9, 19,... as in Fig. 2.3. 

The following remark with Fig. 2.3 will satisfy your curiosity: 

Remark 2.1 Convergence of Fourier Series Reconstruction 

(1) The Fourier series convergence condition A stated in Sect. 2.1.1 guarantees that 
the Fourier coefficients are finite and the Fourier series reconstruction x ;V (f) 
converges to the original time function x(t ) in the sense that 

J | x N (t) — x(t)\ 2 dt -»■ 0 as N -»■ oo 

(2) The Fourier series convergence condition B stated in Sect. 2.1.1 guarantees the 
following: 

- The Fourier coefficients are finite. 

- The Fourier series reconstruction x,v(t) converges to the original time func¬ 
tion x(t) at every t except the discontinuities of x(t) and to the average value 
of the limits from the left/right at each discontinuity. 

(3) Figure 2.3 illustrates that x^{t) has ripples around the discontinuities of x(t), 
whose magnitude does not decrease as N —> oo. This is called the Gibbs 
phenomenon. 
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6 T (t) =S“ = _ 00 6(t-mT) 



(a) An impulse train with period T (b) Its Fourier spectrum 

Fig. 2.4 An impulse train and its CTFT spectrum 


(4) For practical purposes, we do not need to pay attention to the convergence 
condition because the “weird” signals that do not satisfy the condition are not 
important in the study of signals and systems. 

Example 2.2 Fourier Spectrum of an Impulse Train 

Consider an impulse train consisting of infinitely many shifted unit impulses that 
are equally spaced on the time axis: 

h^ = YZ=-J {t ~ mT) (E2 - L1) 

We can use Eq. (2.1.5b) with P = T and a>(, = 2 tz/T to obtain the Fourier 
coefficients as 

/ T/2 tV2 , II rT/2 „ 

S T (t) e- jkwot dt=’ Y) _ S(t- mT)e- jka <> t dt 
■r/2 J-T/2 m—oo 

(since there is only one impulse S(t ) 

within the integration interval [— T/2, T/2]) 

= [ ' m e~ jkao1 dt (1 = 25) e-j^l = 1 V A: 

J-T/2 with r 1= 0 U=0 

This means a flat spectrum that is uniformly distributed for every frequency index. 
Now we can use Eq. (2.1.5a) to write the Fourier series representation of the impulse 



2.1.3 Physical Meaning of CTFS Coefficients - Spectrum 

To understand the physical meaning of spectrum, let us see Fig. 2.5, which shows 
the major Fourier coefficients Ck of a zero-mean rectangular wave for k = —3, —1, 
1, and 3 (excluding the DC component cq) and the corresponding time functions 
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The observation of Fig. 2.5 gives us the following interpretations of Fourier 

spectrum: 

Remark 2.2 Physical Meaning of Complex Exponential Fourier Series Coefficients 

(1) While the trigonometric or magnitude-and-phase form of Fourier series has only 
nonnegative frequency components, the complex exponential Fourier series has 
positive/negative frequency (±kcoo) components that are conjugate-symmetric 
about k = 0, i.e., 

c k (2 '= b) T ^d k e l4,k and c- k °"= c) y d k e~ J<l,k -* \c- k \ = \c k \ and </>_* = -<p k 

as shown in Sect. 2.1.1. This implies that the magnitude spectrum |c*| is (even) 
symmetric about the vertical axis k — 0 and the phase spectrum (p k is odd 
symmetric about the origin. 

(2) As illustrated above, the k th component appears as the sum of the positive and 
negative frequency components 


which denote two vectors (phasors) revolving in the opposite direction with 
positive (counter-clockwise) and negative (clockwise) angular velocities ±kcoo 
[rad/s] round the origin, respectively. 

(3) Figure 2.6 also shows that the spectrum presents the descriptive information of 
a signal about its frequency components. 

To get familiar with Fourier spectrum further, let us see and compare the spec¬ 
tra of the three signals, i.e., a rectangular wave, a triangular wave, and a constant 
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Fig. 2.6 Physical meaning of spectrum - time domain vs. frequency domain 


(DC: Direct Current) signal depicted in Fig. 2.7. The observations are stated in the 
following remarks: 

Remark 2.3 Effects of Smoothness and Period on Spectrum 

(1) The smoother a time function is, the larger the relative magnitude of low 
frequency components to high frequency ones is. Compare Fig. 2.7(al-bl), 
(a2-b2), and (a3-b3). 

(cf.) The CTFS of the unit constant function can be obtained from Eq. (E2.1.3) 
with A — 1 and P — D. 



(al) A rectangular wave with D=1, P=2 (bl) Its magnitude spectrum 



(a2) A triangular wave with D= 1, P= 2 (b2) Its magnitude spectrum 



(a3) A constant signal (b3) Its magnitude spectrum 



Fig. 2.7 The CTFS spectra of rectangular/triangular waves and a DC signal 
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(2) The longer the period P is, the lower the fundamental frequency coq = 2n / P 
becomes and the denser the CTFS spectrum becomes. Compare Fig. 2.7(a4-b4) 
with (al-bl). 

(cf.) This presages the continuous-time Fourier transform, which will be intro¬ 
duced in the next section. 

Now, let us see how the horizontal/vertical translations of a time function x(t) 
affect the Fourier coefficients. 

<Effects of Vertical/Horizontal Translations of x(t) on the Fourier coefficients> 
Translating x(t ) by ±A (+: upward, —: downward) along the vertical axis causes 
only the change of Fourier coefficient do = ao for k = 0 (DC component or average 
value) by ±A. On the other side, translating x(t) along the horizontal (time) axis by 
±f i (+: rightward, —: leftward) causes only the change of phases s) by ^fkcooh , 

not affecting the magnitudes dk of Eq. (2.1.4b) or of Eq. (2.1.5b): 

c' k (2 = b) / x(t - t x ) e- ]k ^‘dt = J x(f - h) e-^-^dt 

= e~^ h J x(t - ti) e-^-^dt^Cke-^ = \ctfAfo - kco 0 t i) 

(2.1.11) 

Note that x(t — t\) is obtained by translating x(t) by t\ in the positive (rightward) 
direction for t\ > 0 and by —t\ in the negative (leftward) direction for t\ < 0 along 
the horizontal (time) axis. Eq. (2.1.11) implies that horizontal shift of x(t) causes a 
change not in its magnitude spectrum but in its phase spectrum. 

2.2 Continuous-Time Fourier Transform of Aperiodic Signals 

In this section we will define the Fourier transform for aperiodic signals. Suppose 
we have an aperiodic signal x(t) of finite duration D > 0 and its periodic extension 
x P (t ) with period P > D that is obtained by repeating x(t) every P s. 

Noting that, as we choose the period P to be longer, x /> (t) appears to be identical 
to x(t) over a longer interval, we can think of x(t) as the limit of Xp(t) as P oo. 
Since xp(t ) is periodic with period P, it can be represented by the Fourier series of 
the form 

xp(t) = ^ Ck e ' lk0H> ' = ^ X( j kw( >) e jk<O0t (o 0 with a>o = 

where the CTFS coefficients are 

X(jkcoo) = Ck = f p e ~ ikW,t dt = / *(0 e~ jkmt dt 

Noting that xp(t) x(t) and coo = 2 n/P 0 as P —>■ oo, we let a>o = dco and 

kcoo = co and take the limits of the above two equations as P —> oo to write the 
continuous-time Fourier transform (CTFT) pair: 
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X(jw) = F{x(t)} 


-j: 


x(t)e jo)t dt (Fourier transform/integral) (2.2.1a) 


x(t) = T 1 {X(joj)} = — f X(joj)e' olt doj (Inverse Fourier transform) 

2n J_oo 

(2.2.1b) 


where X(jco), called the spectrum of x(t), has values at a continuum of frequencies 
and is often written as X(a ;) with the constant j omitted. Like the CTFS of periodic 
signals, the CTFT of aperiodic signals provides us with the information concerning 
the frequency contents of signals, while the concept of frequency describes rather 
how rapidly a signal changes than how fast it oscillates. 

Note that the sufficient condition for the convergence of CTFT is obtained by 
replacing the square-integrability condition (2.1.2a) of Condition A with 


(2.2.2a) 


or by replacing the absolute-integrability condition (2.1.2b) of Condition B with 


(2.2.2b) 


Remark 2.4 Physical Meaning of Fourier Transform - Signal Spectrum and Fre¬ 
quency Response 

(1) If a time function x(t ) represents a physical signal, its Fourier transform 
X(j(o) = !F{x(t)) means the signal spectrum, which describes the frequency 
contents of the signal. 

(2) In particular, if a time function g(t) represents the impulse response of a 
continuous-time LTI (linear time-invariant) system, its Fourier transform 
G(jco) = Figit)} means the frequency response, which describes how the sys¬ 
tem responds to a sinusoidal input of (angular) frequency co (refer to Sect. 1.2.6 
for the definition of frequency response). 

Remark 2.5 Frequency Response Existence Condition and Stability Condition of 
a System 

For the impulse response g(t) of a continuous-time LTI system, the absolute- 
integrability condition (2.2.2b) is identical with the stability condition (1.2.27a). 
This implies that a stable LTI system has a well-defined system function (frequency 
response) G(ja>) = JF{g(t)}. 

Remark 2.6 Fourier Transform and Laplace Transform 

For any square-integrable or absolutely-integrable causal function x(t) such that 
x(t) = 0 V t < 0, the Fourier transform can be obtained by substituting s = jco into 
the Laplace transform: 
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X(jcd) (2 '= a) [ x(t)e~ ja,t dt x(t) °= It<0 f xiOe-^dt^ X(s)\ s=ja> (2.2.3) 
J-OO causal sl S nal Jo 

This argues that for a physical system having causal impulse response g(t), the 
Fourier transform G(jco) of g(t), that is the frequency response, can be obtained by 
substituting s = jco into the system function G(s), which is the Laplace transform 
ofg(t). (See Eq. (1.2.21).) 

Example 2.3 CTFT Spectra of a Rectangular (Square) Pulse and a Triangular 
Pulse 


(a) CTFT Spectrum of a Rectangular (Square) Pulse (Fig. 2.8(a)) 

Consider a single rectangular pulse with height 1 and duration D on the interval 
[-D/2, D/2]: 


Ar D {t ) = A 




A for — D/2 < \t\ < D/2 
0 elsewhere 

(E2.3.1) 


We use Eq. (2.2. la) to obtain the CTFT coefficients 


-2t r/D 0 2 t r/D 
(a) A rectangular pulse and its CTFT spectrum 


p=4D Fourif 

: Period — 


Fourier series |c fc | or \X k 


Daao“o= ~p '■ Fundamental 


11111 k 


(b) A rectangular wave and its CTFS spectrum 


Fourier series IcJ or \X k \ 


~i ffpn nFou 
_ m \ r t 

0 -4 

(c) A rectangular wa 

, K .p. .. P-2D 

nfl.n e 


(c) A rectangular wave and its CTFS spectrum 


Fourier transform \X(ju>) 


-2t r/D 0 2irlD 
(d) A rectangular wave and its CTFT spectrum 


Fig. 2.8 The CTFT or CTFS spectra of rectangular pulses or waves 
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AR D (jco) (2 '= a) J Ar D (t)e J 
mm - e -jo> 


r°i 

t = A I 

J-D, 


= A- 


]<*> 


coD/2 


— AD sine 


(f) 


This CTFT spectrum is depicted in Fig. 2.8(a). The first zero crossing B — 
In ID [rad/s] of the magnitude spectrum is often used as a measure of the fre¬ 
quency spread of a signal and called the zero-crossing ( null-to-null) bandwidth 
of the signal. 

(cf.) As a by-product, we can apply the inverse CTFT formula (2.2.1b) for 
Eq. (E2.3.2) to get the integral of a sine function: 


fu(0 <2 '= b) ^ J RD(jo>)e ja> 


(E2.3.2) 1 f 00 sin(«D/2) . 

= — / D- e ] i 

2n Loo coD/2 

( D\ ( D\o>=2w 1 f°° sin(wD) „ 

u s (t + -)-u s (t--) = -L~ eJ ^ 

Substituting t = 0 into this equation yields 


u: 


- U s (= sign(D) = 


1 for D > 0 

0 for D = 0 

— 1 for D < 0 

(E2.3.3) 


(b) CTFT Spectrum of a Triangular Pulse 

Like Eq. (E2.1.5), which is the CTFS coefficient of a triangular wave, we can 
find the CTFT spectrum of a single triangular pulse x(t) — AX D (t) as 

sin 2 (cuD/2) , / coD \ 

X(jco) = AA d ( jeo ) = AD = AD sme 2 (^^rj (E2.3.4) 

Figure 2.8(a) shows a rectangular pulse and its CTFT spectrum, while Fig. 2.8(b) 
and (c) show two rectangular waves and their CTFS spectra. These figures present 
us an observation about the relationship between the CTFT of a single pulse x(t) 
and the CTFS of its periodic repetition x P (t ) with period P, which is summarized 
in the following remark. 

Remark 2.7 Fourier Series and Fourier Transform 

(1) We will mainly use the complex exponential Fourier coefficients, but seldom 
use the trigonometric or magnitude-and-phase form of Fourier series. Thus, 
from now on, we denote the complex exponential Fourier coefficients of x(t) 



2.3 (Generalized) Fourier Transform of Periodic Signals 


77 


by X k instead of t>, which has been used so far to distinguish it from other 
Fourier coefficients ak, bk, or dk. 

(2) As can be seen from comparing Eqs. (E2.1.2) and (E2.3.2) or (E2.1.5) and 
(E2.3.4), the relationship between the CTFT X(jco) of x(t) and the CTFS coef¬ 
ficient Xk of xp(t) (the periodic extension of x(t) with period P) is as follows: 

XUa>)Uk<oo=2x kl p = XUkcoo) = Xk (2.2.4) 

As the period P gets longer so that the fundamental frequency or frequency 
spacing coo=2n/P decreases, the Fourier coefficients Xk s become more closely 
spaced samples of the CTFT X(jco), implying that the set of CTFS coefficients 
approaches the CTFT as P ->• oo (see Fig. 2.8(c), (b), and (a)). 

(3) Unlike the discrete frequency ka>o of CTFS, the continuous frequency co of 
CTFT describes how abruptly the signal changes rather than how often it 
oscillates. 

(4) If the CTFT of a single pulse x(t ) and the CTFS of the periodic extension xp(t) 
were of different shape in spite of the same shape of x(t) and xp(t) over one 
period P, it would be so confusing for one who wants the spectral information 
about a signal without knowing whether it is of finite duration or periodic. In 
this context, how lucky we are to have the same shape of spectrum (in the sense 
that CTFS are just samples of CTFT) whether we take the CTFT of x(t) or the 
CTFS of x P (t)\ Furthermore, you will be happier to see that even the CTFT of 
xp(t ) (Fig. 2.8(d)) is also of the same shape as the CTFS of xp(t), because one 
might observe one period of xp(t) and mistake it for x(t) so that he or she would 
happen to apply the CTFT for periodic signals. Are you puzzled at the CTFT of 
a periodic signal? Then rush into the next section. 


2.3 (Generalized) Fourier Transform of Periodic Signals 

Since a periodic signal can satisfy neither the square-integrability condition (2.2.2a) 
nor the absolute-integrability condition (2.2.2b), the CTFTs of periodic signals are 
not only singular but also difficult to compute directly. For example, let us try to 
compute the CTFT of x*(t) = e jk(O0 ‘ by using Eq. (2.2.1a): 

nxk(m (2 = U) f edt = f e~ n)t dt 

(033) 1 

-j{co- kcoo ) 
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To get around this mathematical difficulty, let us find the inverse CTFT of 
X k {jo)) = 27T 8(co — kw 0 ) 
by applying the inverse Fourier transform (2.2.1b): 

!F ~ l(2 = lb) — f 2n 8(co — kco<o)e jcot dco (1 = 25) g'*'"’ 0 ' 

2;r J.qo 

This implies a CTFT pair as 

x k {t) = e ik “ 0 ' 4 X k (jco) = In 8{co - kco 0 ) (2.3.2) 

Based on this relation, we get the Fourier transform of a periodic function x(t ) 
from its Fourier series representation as follows: 

I (') (2 = a ’^Er = -o 0 x ‘ e ' lkmt with 0)0 =2 y 

4 XU CO) (2 = 2) ^ ^ ^ S(oj - kw o) (2.3.3) 

This implies that the CTFT of a periodic signal consists of a train of impulses 
on the frequency axis having the same shape of envelope as the CTFS spectrum. 
Figure 2.8(d) is an illustration of Eq. (2.3.3) as stated in Remark 2.7(4). 

Remark 2.8 Fourier Transform of a Periodic Signal 

It would be cumbersome to directly find the CTFT of a periodic function. Thus we 
had better find the CTFS coefficients first and then use Eq. (2.3.2) as illustrated in 
Eq. (2.3.3). 

2.4 Examples of the Continuous-Time Fourier Transform 

Example 2.4 Fourier Transform of an Exponential Function 

For an exponential function (Fig. 2.9(a)) with time constant T > 0 

ei (t)= ^e~ ,/T u s (t) with T > 0, (E2.4.1) 


(a) A unilateral exponential signal (b) Its CTFT spectrum-magnitude 




Fig. 2.9 
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we have the Fourier transform 


E\{ja>) = T{e x (/)} 



1 + jwT 


w £> 


*-Fjf 


0 + (G>n 2 


r(i/r + » 

Z — tan _1 (o>7’) 


whose magnitude is depicted in Fig. 2.9(b). From this magnitude spectrum, we see 
that co c = 1/T is the half-power frequency at which \E\(joj)\ is 1 /~J2 times the 
maximum magnitude 1: 

|£,(»| = 1 = 4=; 1 + (© T) 2 = 2; coT = 1; cu e = i (E2.4.3) 

yi + (a) r) 2 V2 r 

This example makes possible the following interpretations: 

Remark 2.9 Signal Bandwidth and System Bandwidth - Uncertainty Principle 

(1) In case the function e\(t) represents a physical signal itself, the above exam¬ 
ple illustrates the inverse relationship (a kind of duality) between the time and 
frequency domains that the bandwidth B [rad/s] of the signal is inversely pro¬ 
portional to the time-duration T [s], i.e., BT = constant(= 1). Note that the 
bandwidth of a signal, i.e., the width of the frequency band carrying the major 
portion of the signal energy, describes how rich frequency contents the signal 
contains. Such a relationship could also be observed in Example 2.3 and Fig. 2.8 
where the time-duration of the rectangular pulse is D and the signal band¬ 
width, defined as the frequency range to the first zero-crossing of the magnitude 
spectrum, is 2n/D. This observation, called the reciprocal duration-bandwidth 
relationship, is generalized into the uncertainty principle that the time-duration 
and bandwidth of a signal cannot be simultaneously made arbitrarily small, 
implying that a signal with short/long time-duration must have a wide/narrow 
bandwidth [S-l, Sect. 4.5.2], This has got the name from the Heisenberg uncer¬ 
tainty principle in quantum mechanics that the product of the uncertainties in 
the measurements of the position and momentum of a particle cannot be made 
arbitrarily small. 

(2) In case the function e\(t) represents the impulse response of a filter such as 
the RC circuit shown in Fig. 2.10(a), it has another interpretation that the 
bandwidth of the system behaving as a low-pass filter is inversely proportional 
to the time constant T — /?C[s], Note that the system bandwidth of a filter 
describes the width of frequency band of the signal to be relatively well passed 
and that it is usually defined as the frequency range to the 3dB-magnitude 
(half-power) frequency B — l/T [rad/s]. Also note that, in comparison with 
the bandwidth as a frequency-domain “capacity” concept, the time constant 
describes how fast the filter produces the response (output) to an applied input 
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(a) An RC circuit and its transformed (s-domain) equivalent circuit 



(b) The output voltages to a single rectangular pulse input 


Fig. 2.10 An RC circuit and its outputs to rectangular pulse input signals 

signal and that it is defined as the time taken for the output to reach 68.2%(e _1 ) 
of the final (steady-state) value, or equivalently, the time measured until the 
(slowest) term of the transient response (converging towards zero) becomes as 
small as 32.8% of the initial value. 

(3) Referring to Fig. 2.10(b), suppose a rectangular pulse of duration D is applied 
to the RC filter. Then, in order for the low-pass filter to have /ttgh fidelity of 
reproduction so that the output pulse will appear very much like the input pulses, 
the system bandwidth (the reciprocal of time constant RC) of the filter had 
better be greater than the signal bandwidth 2jt/D of the input pulse. 

Example 2.5 Fourier Transform of an Even-Symmetric Exponential Function 
For an exponential function (Fig. 2.11(a)) with time constant T > 0 

e 2 (t) = ^e~ W,T with T > 0, (E2.5.1) 



(a) An even-symmetric exponential signal (b) Its CTFT spectrum-magnitude 

Fig. 2.11 An even-symmetric exponential signal and its CTFT spectrum 
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we have the Fourier transform 

E 2 (j(o) = T[e2(t)} <2 '= a) J 2 T e ' t:l 'e J °" dt 

= ^ { fj r ‘ V“ dt + jf° e ~ ,r V“ dt \ 

~~ 2T(\/T - jco) £ l-oo “ 2T(\/T + jco) 6 

1/2 1/2 1 
“ 1 - jcoT + 1 + jcoT ~ 1 + (wT) 2 

whose magnitude is depicted in Fig. 2.11(b). 


(Q) Why has the magnitude spectrum shorter bandwidth than that in Fig. 2.9(b)? 
(A) It is because the signal in Fig. 2.11(a) is smoother than that in Fig. 2.9(a). 


Example 2.6 Fourier Transform of the Unit Impulse (Dirac Delta) Function 
We can obtain the Fourier transform of the unit impulse function 8(t) as 

V(jco) = JF{5(t)} <2 '= a) J 8(t)e- ja ' dt (1 '= 5) 1 V co (E2.6.1) 


This implies that an impulse signal has a flat or white spectrum, which is evenly 
distributed over all frequencies (see Fig. 2.12). 

It is interesting to see that this can be derived by taking the limit of Eq. (E2.3.2) as 
D -¥■ 0 in Example 2.3 (with A = 1/D) or Eq. (E2.5.2) as T -»■ 0 in Example 2.5: 


• ( wD \ i 

sine I - I = 1 

i \2 71 ) 


, ■ 6(t) 

0 

(a) A unit-impulse signal 


P(M-1 


0 

(b) Its CTFT spectrum-magnitude 


Fig. 2.12 A unit impulse signal and its CTFT spectrum 
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(1.1.33d) (E2.5.1) 1 ,, UT 

S(t) — lirne 2 (t) = lim—e 117 
—> lim E2(jco) ( ^ 2 = 2> lim - 


T —*-0 1 + (cur) 2 " 


As a byproduct, we can apply the inverse Fourier transform (2.2.1b) to obtain an 
expression of the impulse function as 




V{jco)e i<ot dco 


= A) ’ le jm ' 

J _oo 


dco 

(E2.6.2) 


» 2 njt 


2njt 


which is identical with Eq. (1.1.33a). 

Remark 2.10 An Impulse Signal and Its (White/Flat) Spectrum 

(1) Comparing Figs. 2.11 and 2.12, we see that short-duration signals contain 
stronger high-frequency components than long-duration ones do. This idea sup¬ 
ports why a lightning stroke of very short duration produces an observable 
noise effect over all communication signals from the relatively low frequen¬ 
cies (550~ 1600kHz) used in radio system to the relatively higher ones used in 
television system (60MHz for VHF ~470MHz for UHF). 

(2) We often use the impulse function as a typical input to determine the important 
characteristics (frequency response or system/transfer function) of linear time- 
invariant (LTI) systems. One practical reason is because the impulse function 
has uniform (flat) spectrum, i.e., contains equal power at all frequencies so that 
applying the impulse signal (or a good approximation to it) as the input to a 
system would be equivalent to simultaneously exciting the system with every 
frequency component of equal amplitude and phase. 

Example 2.7 Fourier Transform of a Constant Function 

We can obtain the Fourier transform of the unit constant function c(t) = 1 

(Fig. 2.13(a)) as 


C{jw) = Fvf'= &) 


<2 = 2) 2t r 8(co) (E2.7.1) 

with k= 0 


(a) A unit constant (DC) signal 


(b) Its CTFT spectrum-magnitude 


Fig. 2.13 A unit constant (DC) signal and its CTFT spectrum 
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This spectrum, that is depicted in Fig. 2.13(b), shows that a constant signal has only 
DC component with zero frequency, i.e., has all of its (infinite) energy at 0 = 0. 

This can also be obtained by swapping t and co in (E2.6.2) and verified by using 
the inverse Fourier transform (2.2.1b) to show that 

JF- 1 {2t r«(©)} <2 '= b) ^ J 2it 8(co)e jat dco (1 '= 5) 1 (E2.7.2) 

Example 2.8 Fourier Transform of the Unit Step Function 

To compute the Fourier transform of the unit step function u s (t), let us write its 
even-odd decomposition, i.e., decompose u s (t) into the sum of an even function and 
an odd function as 

u s (t) = u e (t) + u 0 (t) (E2.8.1) 

where 

1 \ 1/2 for t ^ 0 

u e (f) = ~(u s (t) + u s {-t)) = j n (E2.8.2) 

2 | 1 for t = 0 

1/2 for t > 0 

0 for t ^ 0 (E2.8.3) 

-1/2 for t < 0 

Then, noting that the even part u e (t) is a constant function of amplitude 1/2 except 
at t = 0, we can use Eq. (E2.7.1) to write its Fourier transform as 

U e (jco) = Hum = {1} (E = 71) 7r 8(pS) (E2.8.4) 

On the other side, the Fourier transform of the odd part can be computed as 

(2 2 1a) r 00 ■ , r°° ° dd even odd 

U 0 (jw) = F{u 0 {t)} = / u a {t)e jm dt■= / u a (t)(coscot — j sin cut) dt 


/ °° oddxodd=even r°° even 

u a (t ) sin cot dt = — j 2 J u 0 (t) sin cot dt 




(E2.8.5) 
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(a) The impulse reponse of an LPF (b) The frequency response of an LPF 

Fig. 2.14 The impulse response and frequency response of an ideal LPF 


where we have used the Laplace transform. Now we add these two results to obtain 
the Fourier transform of the unit step function as 


F{u s {t)} = F{u e (t) + u a (t)} (2 = !) U e (jm) + U 0 (jw) (E2 ' 8A = E2 ' 8 ' 5) tv S(m) + — 

JO) 

(E2.8.6) 

Example 2.9 Inverse Fourier Transform of an Ideal LPF Frequency Response 
Let us consider the frequency response of an ideal lowpass filter (LPF) depicted 
in Fig. 2.14(b): 


G{jco) = 


0 


for \co\ < B 
for \m\ > B 


(E2.9.1) 


Taking the inverse Fourier transform of this LPF frequency response yields the 
impulse response as 

git) = J r ~ 1 {G(jw)} <2 '= b) J G(jw)e ]Wt dco= J le~ J0> ‘ dm 

1 jKt jRt sinBf B {Bt\ 

=-( e jBt - e~ jBt ) = -= -sine — (E2.9.2) 

2 njt Jtt n J 

which is depicted in Fig. 2.14(a). 

(cf.) It may be interesting to see that a rectangular pulse and a sine function consti¬ 
tute a Fourier transform pair, i.e., the Fourier transforms of rectangular pulse 
and sine function turn out to be the spectra of sine function and rectangu¬ 
lar pulse function form, respectively (see Figs. 2.8(a) and 2.14). This is a 
direct consequence of the duality relationship between Fourier transform pairs, 
which will be explained in detail in Sect. 2.5.4. 


Remark 2.11 Physical Realizability and Causality Condition 

If a system has the frequency response that is strictly bandlimited like G(jco) 
given by Eq. (E2.9.1) and depicted in Fig. 2.14(b), the system is not physically 
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realizable because it violates the causality condition, i.e., g(t) ^ 0 for some t < 0 
while every physical system must be causal (see Sect. 1.2.9). 

Example 2.10 Fourier Transform of an Impulse Train 
Let us consider an impulse train 


S T (t) = oo 8(? " mT) (E2.10.1) 


Since this is a periodic function, we first write its Fourier series representation from 
Eq. (2.1.10) as 

S T (t) (2 '= 0> j_ y e j k <o,t 0Js = JL (E2.10.2) 

Then we use Eq. (2.3.2) with coq = co s = 2tt/ T to obtain the Fourier transform as 
VAjco) ( '= 0 2) 2) ^ 8 ^ ~ 

= Y^k—oo S ( a) + kc ° s) with Ws= Y (E2.10.3) 


(cf.) Applying Eq. (2.2.1b) to take the inverse Fourier transform of Eq. (E2.10.3) 
will produce Eq. (2.10.2). 

(cf.) Note that, as the period T (the interval between the impulses in time) increases, 
the fundamental frequency co s = 2n/T (the spacing between the impulses in 
frequency) decreases. This is also a consequence of the duality relationship 
between Fourier transform pairs. 

Example 2.11 Fourier Transform of Cosine/Sine Functions 


(a) The Fourier transform of x(t) = sin (o)\t) = (e' aM ‘ — e ] " M t )/j2 can be 
obtained as 


X(jco) = .F{sin(<yit)} = — lF{e jw,t — e ja>lt } (2 = 2) jjr(8(co + coi) — 8(cd — coi)) 

(E2.11.1) 

(b) The Fourier transform of x(t) = cos (coit) = (e ,,1> ' t + e^' 0J,, )/2 can be 
obtained as 


X(jco) = ^ 7 {cos(<yi/)} = -lF{e jmt + e 


mt ] = 7T(S(co +COi) +S(co - (O!)) 

(E2.11.2) 
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2.5 Properties of the Continuous-Time Fourier Transform 

In this section we are about to discuss some basic properties of continuous-time 
Fourier transform (CTFT), which will provide us with an insight into the Fourier 
transform and the capability of taking easy ways to get the Fourier transforms or 
inverse Fourier transforms. 

(cf.) From now on, we will use X(co) instead of X(jco) to denote the Fourier 
transform of x(t). 

2.5.1 Linearity 

With F{x{t)} = X(oj) and T\y(t)) = Y(w), we have 

ax(t) + by(t)£aX(co) + bY(co), (2.5.1) 

which implies that the Fourier transform of a linear combination of many functions 
is the same linear combination of the individual transforms. 

2.5.2 (Conjugate) Symmetry 

In general, Fourier transform has the time reversal property: 

T{x{— J x{—t)e~ j<ot dt mj x(r)e ja)T (—dr) T = j x(t)e j(0t dt 

T-H! X(-a>) (2.5.2) 

In case x(t) is a real-valued function, we have 

X(-co) <2 =' d, j x (t)e- ]( - a)> dt = j x(t)e- ( -' )M, dt 

X*(w) (complex conjugate of X («)) 

or equivalently, 

Re{X(-o>)} + yIm{X(-ft))} = Re{X(«)} - ;Im{X(cu)} 

\X(-co)\ZX(-co) = \X(co)\Z—X(co) (2.5.3) 
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This implies that the magnitude/phase of the CTFT of a real-valued function is an 
even/odd function of frequency co. Thus, when obtaining the Fourier transform of a 
real-valued time function, we need to compute it only for co > 0 since we can use 
the conjugate symmetry to generate the values for co < 0 from those for co > 0. 
In other words, for a real-valued time function, its magnitude and phase spectra are 
symmetrical about the vertical axis and the origin, respectively. 

For an even and real-valued function x e (t) such that x e (—t) = x e (t), its Fourier 
transform is also an even and real-valued function in frequency co: 


X e (-a>) 


J x e {t) dt'= j x e (-t)e~ ja>T dt 

T, /°° x e (r) e~ im dr (2 = U) X e (co) 


(2.5.4a) 


Also for an odd and real-valued function x a (t) such that x 0 {—t) — —x 0 (t), its 
Fourier transform is an odd and imaginary-valued function in frequency co: 


X 0 (—co) ^ J°° xM e~ K -^ dt f°° x 0 (-T)e~ j<ar dT 

Xo ( -t)=- Xc (t) _[ Xo(r)e -ja>r dr (2 h U) _ Xo (co) (2.5.4b) 

odd 


Note that any real-valued function x(t) can be expressed as the sum of an even 
function and an odd one: 


x{t) = x e {t) + x 0 (t) 

where 

x e (t) = + jc(-O) and Xo (t) = l -{x{t) - x{-t)) 

Thus we can get the relations 

X(co) = FiXeit)} + JF{x 0 (t)} = X e (oj) + X„(co) 

Re{X( ©)} + jlm{X( w)} = X e (co) + X 0 (co) 

which implies 

even and real-valued x c (t) -5- Ref X( &>)} even and real-valued (2.5.5a) 

p 

odd and real-valued x 0 (t) jlmf X( oj)} odd and imaginary-valued (2.5.5b) 
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2.5.3 Time/Frequency Shifting (Real/Complex Translation) 

For a shifted time function x\(t) = x(t — t\ ), we have its Fourier transform 

F{x{t - /,)} (2 '= a) J x(t - /,) e- ja,t dt * J x(t) e - joK,+h) dt 

(2 = a) -F{x(f)} ri ; x(f-f,)4 X(tn) (2.5.6) 

This implies that real translation (time shifting) of x(t) by t\ along the t -axis will 
affect the Fourier transform on its phase by — (at\, but not on its magnitude. This is 
similar to Eq. (2.1.11), which is the time shifting property of CTFS. 

In duality with the time shifting property (2.5.6), the complex translation (fre¬ 
quency shifting) property holds 

x(t) e ja> '4x(o)-o)i) (2.5.7) 

2.5.4 Duality 

As exhibited by some examples and properties, there exists a definite symme¬ 
try between Fourier transform pairs, stemming from a general property of duality 
between time and frequency. It can be proved by considering the following integral 
expression 

f(u) = J g(v)e~ Juv dv v ~^ v J g(-v)e Juv dv (2.5.8) 

This, with ( co , t) or (±t, =po)) for ( u, v), yields the Fourier transform or inverse 
transform relation, respectively: 

g(t)e~ ja>t dt (2 = U) F{g(t)} : g(t)4/(cn) (2.5.9a) 

/(± t) = J gijyco) e ]( ° * dco ( ~ = b> 2nT~ x {g(T<A>}: /(± t) 4 2tt g(^cn) 

(2.5.9b) 

It is implied that, if one Fourier transform relation holds, the substitution of (±t, ^faj) 
for (co, t) yields the other one, which is also valid. This property of duality can be 
used to recall or show Fourier series relations. We have the following examples: 

(Ex 0) g(t) = x(t) & f(oj) = X(co) 
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Fig. 2.15 Dual relationship between the Fourier transform pairs 


O X(t) — A 2 7T x(—co) = 2nA S(—co) (See Example 2.7.) 

(Ex 2) x(t) = j 


I 1 for \t | < D f 
|o for \t I > D (2.5.9a) 


(E2 3 1) / Dw\ 

X(co) = 2D sine I -) (See Example 2.9 and Fig.2.15) 


1 B (Bt\ t 

—X(t) = — sine I — ) x(-co) = 

2JT 7t \ JT ) (2.5.9b) 


1 for \co\ < B 
0 for \co\ > B 


2.5.5 Real Convolution 

For the (linear) convolution of two functions x(t) and g(t) 

y(t) = x(t) * g(t) = J x{x)g{t - r) dr = J g(r)x(t - r) dr = g(t)*x(t), 

(2.5.10) 
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we can get its Fourier transform as 

= Hyit)} J°° { f°° x(r)g(t - z) dr j e-^dt 
— J x(r)e~ ja>T | J git - T)e~ JW(, ~ r) dt^dr 

xiT)e~ j<or Gico)dT = Giw)J x (r)e j " ,T dz i2 "_]' d) G(a>)X((o) 
y(t ) = x(t) * g(t ) 4 7(CU) = X(co) G((d) (2.5.11) 


where Y(w) = Fiyit)}, X(oj) = j r {x(f)}, and G(co) - ^{git)). This is the 
frequency-domain input-output relationship of a linear time-invariant (LTI) system 
with the input x(t), the output y(t), and the impulse response git) where G(<y) is 
called the frequency response of the system. 

On the other hand, if two functions Xp(t) and grit) are periodic with com¬ 
mon period P, their linear convolution does not converge so that we need another 
definition of convolution, which is the periodic or circular convolution with the 
integration performed over one period: 

y P {t) = x P (t)*g P (t) = / x P (T)gp(t - r) dr 
p Jp 

= f gp(r)x P (t -z)dr = g P (t) * x P {t) (2.5.12) 

Jp p 

where * denotes the circular convolution with period P. Like the Fourier transform 
of a linear convolution, the Fourier series coefficient of the periodic (circular) con¬ 
volution turns out to be the multiplication of the Fourier series coefficients of two 
periodic functions xp(t) and grit) (see Problem 2.8(a)): 

MO = MO * gp(t ) Fou “ es Y k = X k G, (2.5.13) 


where Y k , X k , and G k are the Fourier coefficients of y k it), x P it), and grit), 
respectively. 

2.5.6 Complex Convolution (Modulation/Windowing) 

In duality with the convolution property (2.5.11) that convolution in the time 
domain corresponds to multiplication in the frequency domain, we may expect the 
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modulation property that multiplication in the time domain corresponds to convolu¬ 
tion in the frequency domain: 

y(t) = x(t)m(t) 4 Y(co) = ^X(w) * M{w) (2.5.14) 

where Y{oo) = !F{y{t)}, X(co) = lF{x(t)}, and M(co) = T{m(t)\. 

On the other hand, if two functions xp(t) and nipit) are periodic with common 
period P , then their multiplication is also periodic and its Fourier series coefficient 
can be obtained from the convolution sum (see Problem 2.8(b)): 

y P {t) = xp{t)fhp{t) Fouri ?> series Y k = ] - J^Z-oo Xn Mk ~ n (2 - 5 ’ 15) 

where Y k , X k , and M k are the Fourier coefficients of yp(t), xp(t), and mp(t), 
respectively. 

Example 2.12 Sinusoidal Amplitude Modulation and Demodulation 

(a) Sinusoidal Amplitude Modulation 

Consider a sinusoidal amplitude-modulated (AM) signal 

x m (t) = x{t)m{t) = x(t) cos(co c t) (E2.12.1) 

Noting that the Fourier transform of the carrier signal m(t) = cos (co c t) is 

M{co) = T\m(t)\ = J'fcos^f)} <E2 = ' 2) jr(S(<u + oj c ) + 8(co - co c )) 

(E2.12.2) 

we can use the modulation property (2.5.14) to get the Fourier transform of the 
AM signal as 


X m (co) = lF{x m (t)} = lF{x(t) cos w c /} (2 = 14) J_x(«) * M(co) 

— ~ -— X(a)) * 7t(S((o + co c ) + S(co — co c )) 

(1 = 2) l -{X{(o + a> c ) + X(co - co c )) (E2.12.3) 

This imphes that the spectrum of the AM signal x(t) cos (co c t) consists of the 
sum of two shifted and scaled versions of X(co) = lF{x(t)). Note that this result 
can also be obtained by applying the frequency shifting property (2.5.7) to the 
following expression: 


x m {t) = x(t) cos(co c t) 


2 


(.x{t)e ]0>c ' + x(t) e~ 


ct y 


(E2.12.4) 
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(b) Sinusoidal Amplitude Demodulation 

In an AM communication system, the receiver demodulates the modulated 
signal x m (t) by multiplying the carrier signal as is done at the transmitter: 

x d { t) = 2 x m (t) cos (co c t) (E2.12.5) 

We can use the modulation property (2.5.14) together with Eqs. (E2.12.3) 
and (E2.12.2) to express the Fourier transform of the demodulated signal in 
terms of the signal spectrum X(co) as 


X d (oj) = F{x d (t)} = T{x m {t)2 cos a> c t] (2 '= 4) ^X m (co) * 2 M(co) 

— ~ —— — (X(co + a > c ) + X(co — co c )) * 2jt(S(a> + a> c ) + 8(co — co c )) 
(E2.12.3) 2n 2 

(1 = 2) l(X(0) + 2o) c ) + X(OJ) + X(a>) + X(0) - 2co c )) 

= ^X(o) + 2w c ) + X{w) + X -X{a> - 2co c ) (E2.12.6) 

Example 2.13 Ideal (Impulse or Instant) Sampler and Finite Pulsewidth Sampler 
(a) Ideal Sampling 

We can describe the output of the ideal (or impulse or instant) sampler to a 
given input x(t) as 

x*(f) = x(t) 8 r (t) (s T (t) = 8(t — mT) : the impulse train) 

(E2.13.1) 

This is illustrated in Fig. 2.16(al). Here, the switching function has been mod¬ 
eled as an impulse train with period T and its Fourier transform is given by 
Eq. (E2.10.3) as 

V T (co) (E2 =° 3)2 ^J^--J^ + k(0s) = T (E2.13.2) 

which is shown in Fig. 2.16(d). We can use the modulation property (2.5.14) 
together with Eq. (E2.13.2) to express the Fourier transform of the ideal sampler 
output in terms of the input spectrum X(co) as 

X*(co) (2 '= 14) x(co) * V T (w) (E2 = ' 2) _ y X((o) * 8(co + kco s ) 

2rc T *—'k=-oo 

(1 = 1] ^ X(oj + kc ° s) (E2.13.3) 


which is depicted in Fig. 2.16(dl). 




2.5 Properties of the Continuous-Time Fourier Transform 



(al) Output of an ideal (impulse) sampler 



0 D T 2T 37 47 5 T 

(a2) Output of a finite pulsewidth sampler 


_ . 

(b) The spectrum of a signal 



(cl) The spectrum of the impulse train 6j{t) (c2) The spectrum of the rectangular wave r D/T {f) 


if&M = l*-(<4h si 



(dl) Output spectrum of the ideal sampler (d2) Output spectrum of the finite pulsewidth sampler 
Fig. 2.16 Ideal sampler and finite pulsewidth sampler 


(b) Finite Pulsewidth Sampling 

We can describe the output of a finite pulsewidth sampler with period T to a 
given input x(t) as 

x s (t) = x(t) f D/T {t) (E2.13.4) 

(td/tCO : a rectangular wave with duration D and period T) 

This is illustrated in Fig. 2.16(a2). Here, the switching function has been mod¬ 
eled as a rectangular wave, r D / P (t), with duration D and period T. Noting that 
from Eq. (E2.1.3), the Fourier series representation of this rectangular wave is 


e ik ‘ 0>t with co s 


2jz 

~Y 


(E2.13.5) 
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we can use Eq. (2.3.3) to write its Fourier transform as 

Rd/p((o) (2 =t -jr T. l c k S(co - kw s ) with c k = D sine ^ 

(E2.13.6) 

which is shown in Fig. 2.16(c2). Now we can apply the modulation property 
(2.5.14) together with Eq. (E2.13.6) to express the Fourier transform of the 
finite pulsewidth sampler output in terms of the input spectrum X(co) as 

X,(ja>) (2 '= 4) * R d/p {w ) (E2 = ' 6) i J2Z-oo X(m) * Ck S(C ° ~ k( ° s) 

(1 = 22) I ^ c k X(co - koo s ) (E2.13.7) 

which is depicted in Fig. 2.16(d2). 

2.5.7 Time Differential/Integration - Frequency 
Multiplication/Division 

By differentiating both sides of the inverse Fourier transform formula (2.2.1b) w.r.t. 
t, we obtain 

(jr t eJWt ^) da) = 2 ^ / U(oX(co))e JW, d(o (2.5.16) 

which yields the time-differentiation property of the Fourier transform as 

jcoX(co) (2.5.17) 

This means that differentiation in the time domain results in multiplication by jco in 
the frequency domain. 

On the other hand, the time-integration property is obtained by expressing 
the integration of x(t ) in the form of the convolution of x(t) and the unit step 
function u s (t) and then applying the convolution property (2.5.11) together with 
Eq. (E2.8.6) as 

J x(r)dr = J x{x) u s (t - x) dx = x(t) * u s (t) 

7 r { x (t)}JF{ Mj ( ? )} (E =' 6) n X(cd)S(co) + —X(u) = n X(0)S(co) + —X(aj) 
jco jco 

(2.5.18) 
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where the additional impulse term ttX(0)S(co) on the RHS reflects the DC value 
resulting from the integration. This equation is slightly above our intuition that 
integration/differentiation in the time domain results in division/multiplication by 
jco in the frequency domain. 

The differentiation/integration properties (2.5.17)/(2.5.18) imply that differenti¬ 
ating/integrating a signal increases the high/low frequency components, respectively 
because the magnitude spectrum is multiplied by \jw\ = co (proportional to fre¬ 
quency co) or | \/jco\ = \/co (inversely proportional to frequency co). That is why a 
differentiating filter on the image frame is used to highlight the edge at which the 
brightness changes rapidly, while an integrating filter is used to remove impulse-like 
noises. Note also that a differentiator type filter tends to amplify high-frequency 
noise components and an integrator type filter would blur the image. 

2.5.8 Frequency Differentiation - Time Multiplication 


By differentiating both sides of the Fourier transform formula (2.2.1a) w.r.t. co, we 
obtain 

(2 =' a) / X (t) (J-e-J^dt =-j j ( tx{t))e~ jo>t dt (2.5.19) 

which yields the frequency-differentiation property of the Fourier transform as 


This means that multiplication by t in the time domain results in differentiation w.r.t. 
co and multiplication by j in the frequency domain. 


2.5.9 Time and Frequency Scaling 

The Fourier transform of x(at ) scaled along the time axis can be obtained as 
F{x{at)} = J x{at) e~ io>, dt 

which yields the time and frequency scaling property of Fourier transform: 


This is another example of the dual (inverse) relationship between time and fre¬ 
quency. A common illustration of this property is the effect on frequency contents of 



96 


2 Continuous-Time Fourier Analysis 


playing back an audio tape at different speeds. If the playback speed is higher/slower 
than the recording speed, corresponding to compression^ >l)/expansion(a<l) in 
time, then the playback sounds get higher/lower, corresponding to expansion/ 
compression in frequency. 


2.5.10 Parseval’s Relation (Rayleigh Theorem) 

If x(t ) has finite energy and !F{x(t)} = X(co), then we have 


(Proof) 

/: 


\x(t)\ 2 dt = ^ J°° \X(co)\ 2 dw 

\x(t)\ 2 dt = J x{t)x*(t) dt 

(_=n»/ X*(w)e~ J0>t dw 

l2 ' iW 2 'nL X ' MXMda, = iL 


(2.5.22) 


J dt 

dw 

\X{w)\ 2 dw 


This implies that the total energy in the signal x(t) can be determined either by 
integrating |x(f)| 2 over all time or by integrating \X(a))\ 2 /In over all frequencies. 
For this reason, \X(co)\ 2 is called the energy-density spectrum of the signal x(t). 

On the other hand, if Xp(t) is periodic with period P and its Fourier series 
coefficients are X^s, then we have an analogous relation 

f \x P (t)\ 2 dt= i Er=_oo ,Xi|2 (2 - 5 - 23) 


where | Xk\ 2 /P is called the power-density spectrum of the periodic signal xp(t). 

2.6 Polar Representation and Graphical Plot of CTFT 

Noting that a signal x(t) can be completely recovered from its Fourier trans¬ 
form X(w) via the inverse Fourier transform formula (2.3.1b), we may say that 
X(co) contains all the information in x(t). In this section we consider the polar 
or magnitude-phase representation of X(oj) to gain more insight to the (generally 
complex-valued) Fourier transform. We can write it as 


X(a>) = \X(oj)\ZX(oj) 



2.6 Polar Representation and Graphical Plot of CTFT 
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V^\Ay - x - AA - vAy" A ' 1 

(a) 0i = 02 = 03 = 0 [rad] 



(b) 0! = 3 [rad], 02 = 6 [rad], and 0 3 = 9 [rad] 



(c) 0! = 3 [rad], 0 2 = 2 [rad], and 0 3 = 1 [rad] 


Fig. 2.17 Plots of x(t) = 0.5 cos(2 nt — 0i) + cos(4tt? — 02) + (2/3) cos(6jrf — 0 3 ) with different 
phases 


where |X(o>)| and ZX(co) give us the information about the magnitudes and phases 
of the complex exponentials making up x(t). Notice that if x(t) is real, \X(oj)\ is an 
even function of co and ZX(co) is an odd function of co and thus we need to plot the 
spectrum for co > 0 only (see Sect. 2.5.2). 

The signals having the same magnitude spectrum may look very different depend¬ 
ing on their phase spectra, which is illustrated in Fig. 2.17. Therefore, in some 
instances phase distortion may be serious. 


2.6.1 Linear Phase 

There is a particular type of phase characteristic, called linear phase, that the phase 
shift at frequency co is a linear function of co. Specifically, the Fourier transform of 
x(t) changed in the phase by —aco, by the time shifting property (2.5.6), simply 
results in a time-shifted version x(t — a): 

Xi(a>) = X(co)Z -occo = X(co)e- Jaa 4 Xl (t) = x(t - a) (2.6.1) 

For example, Fig. 2.17(b) illustrates how the linear phase shift affects the shape 
of x(t). 


2.6.2 Bode Plot 

To show a Fourier transform X(co), we often use a graphical representation consist¬ 
ing of the plots of the magnitude \X(co)\ and phase ZX(co) as functions of frequency 
co. Although this is useful and will be used extensively in this book, we introduce 
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another representation called the Bode plot, which is composed of two graphs, 
i.e., magnitude curve of log-magnitude 201og 10 \X(to)\ [dB] and the phase curve 
of ZX(oj) [degree] plotted against the log frequency log 10 co. Such a representation 
using the logarithm facilitates the graphical manipulations performed in analyzing 
LTI systems since the product and division factors in X(co) become additions and 
subtractions, respectively. For example, let us consider a physical system whose 
system or transfer function is 


G(s) = 


*(1 + 7i«)(l + T 2 s ) 
s(l + T a s)(l+2ST b s + (T b s) 2 ) 


( 2 . 6 . 2 ) 


As explained in Sect. 1.2.6, its frequency response, that is the Fourier transform of 
the impulse response, is obtained by substituting s = jco into G(s): 


G{jw) = G{s)\ s=j0> 


KG + jco 7i)(l + jco T 2 ) 

Ml + jco T a ){ 1 + jco2tjT b - ( coT b ) 2 ) 


(2.6.3) 


The magnitude of G(jco) in decibels is obtained by taking the logarithm on the base 
10 and then multiplying by 20 as follows: 


|G(MI =201og 10 |G(M|[dB] 

= 201og 10 |/sT| +201og 10 |l +j(o Ti\ +201og 10 |l + jco T 2 \ 

- 201og 10 \jco\ - 20log 10 \l + jco T a \ 

- 20 log 10 11 + j &)2f T b - (coT b ) 2 \ (2.6.4a) 

The phase of G(jco) can be written as 


ZG(co) = ZK+ Z(1 + jco Ti) + Z( 1 + jco T 2 ) - Zjco - Z(1 + jco T a ) 

- Z(1 + jco2t;T b - (coT b ) 2 ) (2.6.4b) 


The convenience of analyzing the effect of each factor on the frequency response 
explains why Bode plots are widely used in the analysis and design of linear time- 
invariant (LTI) systems. 

(cf.) The MATLAB function “bode (n, d, . .) ” can be used to plot Bode plots. 


2.7 Summary 

In this chapter we have studied the CTFS (continuous-time Fourier series) and 
CTFT (continuous-time Fourier transform) as tools for analyzing the frequency 
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characteristic of continuous-time signals and systems. One of the primary motiva¬ 
tions for the use of Fourier analysis is the fact that we can use the Fourier series or 
transform to represent most signals in terms of complex exponential signals which 
are eigenfunctions of LTI systems (see Problem 2.14). The Fourier transform pos¬ 
sesses a wide variety of important properties. For example, the convolution property 
allows us to describe an LTI system in terms of its frequency response and the modu¬ 
lation property provides the basis for the frequency-domain analysis of modulation, 
sampling, and windowing techniques. 


Problems 


2.1 Fourier Series Analysis and Synthesis of Several Periodic Functions 



(c) A half-rectified sinusoidal wave 

Fig. P2.1 



(b) A triangular wave 



(d) A full-rectified sinusoidal wave 


(a) Noting that the stair wave in Fig. P2.1(a) can be regarded as the sum 
of three scaled/time-shifted rectangular (square) waves with common 
period 6[s] and different durations 

x a (t) = 6r 3/6 (f - 1.5) - 3 + 3f, /6 (t - 1.5) - 3f 1/6 (f - 4.5), (P2.1.1) 

use Eq. (E2.1.3) together with (2.1.9) to find its complex exponential 
Fourier series coefficients. Then complete the following MATLAB pro¬ 
gram “cir02p_01a.m” and run it to plot the Fourier series representation 
(2.1.7) to see if it becomes close to x a (t ) as the number of terms in 
the summation increases, say, from 5 to 20. Also, compare the Fourier 
coefficients with those obtained by using “CtFS .exponential()”. 
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(b) Use Eqs. (E.2.1.6) together with (2.1.9) to find the complex exponential 
Fourier series coefficients for the triangular wave in Fig. P2.1(b). Then 
compose a MATLAB program, say, “cir02p01b.m” to plot the Fourier 
series representation (2.1.7) and run it to see if the Fourier series repre¬ 
sentation becomes close to Xb(t ) as the number of terms in the summation 
increases, say, from 3 to 6. Also, compare the Fourier coefficients with 
those obtained by using “CtFS-exponential()”. 

(c) Consider a half-wave rectified cosine wave Xf,(t) = maxfcos coot, 0), 
which is depicted in Fig. P2.1(c). We can use Eq. (2.1.5b) to obtain the 
Fourier coefficients as 


rP /4 

k = f cos co 0 te~ jklO0, dt 

J-p /a 

1 r p/4 , 27 r 

= - / (e JW0 ‘ + e-^e-^ 1 dt with co 0 = — = n 

2 j-p /4 P 

:^lor-l 1 / 1 c -Kk-V)cookA : . . * c ~/(*+l)<»oA 

2 \-j(k - l)<wo -j(k + 1 )co 0 ) 


(k - 1)7r 

=2/B(even)^ , 


(-1)M+12 

1)7T 


I ( 1 A _ 

7T \k (k 2 ~ 

i -i r p/4 

= / {e Jmt + e~ ja>0, )e ±im>t dt 

J — P/4 

i r p / 4 p i 

m / (i + ^‘)dt = - = - 

4 J-P /4 4 Z 
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Thus compose a MATLAB program, say, “cir02p01c.m” to plot the 
Fourier series representation (2.1.7) and run it to see if the Fourier series 
representation becomes close to Xh(t ) as the number of terms in the sum¬ 
mation increases, say, from 3 to 6. Also, compare the Fourier coefficients 
with those obtained by using “CtFS_exponential()”. 

(d) Consider a full-wave rectified cosine wave Xf(t) = | cos co^t |, which 
is depicted in Fig. P2.1(d). Noting that it can be regarded as the sum 
of a half-wave rectified cosine wave Xh(t ) and its P/2-shifted version 
Xh(t — P/2), compose a MATLAB program, say, “cir02p01d.m” to plot 
the Fourier series representation (2.1.7) and run it to see if the Fourier 
series representation becomes close to Xf(t) as the number of terms in 
the summation increases, say, from 3 to 6. Also, compare the Fourier 
coefficients with those obtained by using “CtFS .exponential()”. 

(cf.) In fact, the fundamental frequency of a full-wave rectified cosine wave 
is 2coo = 4ix/P, which is two times that of the original cosine wave. 

2.2 Fourier Analysis of RC Circuit Excited by a Square Wave Voltage Source 
Figure P2.2(a) shows the PSpice schematic of an RC circuit excited by a rect¬ 
angular (square) wave voltage source of height ±V m = ±7r, period P = 2[s], 
and duration (pulsewidth) D — l[s], where the voltage across the capacitor 
is taken as the output. Figure P2.2(b) shows the input and output waveforms 
obtained from the PSpice simulation. Figure P2.2(c) shows the Fourier spectra 
of the input and output obtained by clicking the FFT button on the toolbar 
in the PSpice A/D (Probe) window. Figure P2.2(d) shows how to fill in the 
Simulation Settings dialog box to get the Fourier analysis results (for chosen 
variables) printed in the output file. Figure P2.2(e) shows the output file that 
can be viewed by clicking View/Output -File on the top menu bar and pulldown 
menu in the Probe window. 

(a) Let us find the three leading frequency components of the input u, (t) and 
output v 0 (t). To this end, we first write the Fourier series representation of 
the rectangular wave input v/(t) by using Eq. (E2.1.3) as follows: 

»,(<) = 2n iWr - 0.5) - * ,E =t 3 ’ V” 2„ Sin(t,,/2) cos br(< - 0.5) 
*—'k= i kn/2 

E oo 4 44 

- sin knt =4 sin ixt -\ — sin 3nt -\ — sin 57rt + ■ ■ ■ 
*=odd k 3 5 

(P2.2.1) 

Since the RC circuit has the system (transfer) function and frequency 
response 


G(s) = 


1/sC 
R + 1 /sC 


1 + s RC' 


G(j©) = . , 1 Dr , = , 1 Z - tan" 1 coRC, (P2.2.2) 

1 + JcoRC + ( W RC ) 2 
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(a) PSpice schematic for the RC circuit excited by a square-wave source 



(b) The input and output voltage waveforms 




(d) Simulation Settings window and Transient Output File Options dialog box 


Fig. P2.2 (continued) 
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** Proflie: "SCHEHATICl-tran" [C:\ORCAJA Sig02p02-pspicefiles\tran.Sim] 

*Analysis directives: 

■FOUR 0.5 5 V([N00183]) V([N00070]) 

*"*' FOURIER ANALYSIS TEMPERATURE - 27.000 DEG C 

FOURIER COMPONENTS OF TRANSIENT RESPONSE V(N00183) 

DC COMPONENT = 3.14032 2 E-03 (do) 

HARMONIC FREQUENCY FOURIER NORMALIZED PHASE NORMALIZED 

NO(Jfc) (HZ) COMPONENT COMPONENT (DEG) PHASE (DEG) 

1 S.OOOE-Ol(/ 0 ) 4.000E+00Wi) 1. OOOE+OO -1.800E-Ol(^i) 0.000E+00 

2 1.000E+00(2/o) 6.28IE-03W2) 1.570E-03 8.964E+O1(02) 9.000E+01 

3 1.500E+00(3/o) 1.333E+00tf3) 3.333E-01 -5.401E-01<^3) -7.176E-10 

4 2.000E +00(4/1) 6.281E-03(4i) 1.S70E-03 8.928E+01((!>i) 9.000E+01 

5 2.500E+00(5^o ) 8.000E-01(r?s) 2.000E-01 -9.002E-01(^j) -3.588E-09 

TOTAL HARMONIC DISTORTION - 3.887326E+01 PERCENT 

FOURIER COMPONENTS OF TRANSIENT RESPONSE V(N00070) 

DC COMPONENT = 3.141583E-03(rfo) 

HARMONIC FREQUENCY FOURIER NORMALIZED PHASE NORMALIZED 

NO(Jfc) (HZ) COMPONENT COMPONENT (DEG) PHASE (DEG) 

1 5.000E-01(/o) 2.911E+00(4i) 1.OOOE+OO -4.348E+01($) 0.OOOE+OO 

2 1.000E+00(2^) 2.945E-03(Z?2) 1.012E-03 2,759E+01({^) 1.146E+02 

3 1.5OOE+OO(3/ 0 ) 4.446E-01(r?3) 1.S27E-01 -7.106E+01((>3) 5.939E+01 

4 2.000E+00(4/j) 1.611E-03(r(4) S.S34E-04 1.414E+Dl(^i) 1.881E+02 

5 2.500E+00(5Jo) 1. S6IE-O1W5) 5.705E-02 -7.892E+0l((^s) 1.38SE+02 

TOTAL HARMONIC DISTORTION = 1.630388E+01 PERCENT 

_ JOB CONCLUDED _ 

(e) The PSpice output file with FFT analysis 
Fig. P2.2 PSpice simulation and analysis for Problem 2.2 


its output to the input v,(t) (described by Eq. (P2.2.1)) can be written a 




sin (k coot — tan 1 kwoRC) 


:2m+1 kyfl + (kwo RC) 2 

with wo = jr = n (P2.2.3) 

Show that the three leading frequency components of the output pha- 
sor are 

yW =' G(jw 0 )V < i l) = 4 _/ - tan" 1 w 0 RC 

y/l + {w 0 RC) 2 

RC -° 3 =Z- tan -1 0.3;r = 2.91 Z - 43.3° (P2.2.4) 


v/1 + (0.3;r) 2 
V®- ^GUlwoW™ m 


=Z — tan 1 3 wqRC 


3/l + (3 w 0 RC) 2 
=Z - tan" 1 0.97T = 0.4446Z - 70.5° (P2.2.5) 


3^1 + (0.9tt) 2 
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V< 5) = 5 GO'5tu 0 )Vf > = —- 4 -Z - tan" 1 5 w 0 RC 

5jTT(5(ooRCf 

RC ^$ ^ ^ _ tan -i ] 57r _ o.166Z - 78° (P2.2.6) 

5Vl+(1.57r) 2 

where the phases are taken with that of sin cot as a reference in the sine- 
and-phase form of Fourier series representation in order to match this 
Fourier analysis result with that seen in the PSpice simulation output file 
(Fig. P2.2(e)). 

(cf.) Note that PSpice uses the sine-and-phase form of Fourier series 
representation for spectrum analysis as below: 

x(t) = d' 0 + y 1 d' k sin (kco 0 t + <p' k ) (P2.2.7a) 

where the Fourier coefficients are 

do = a 0 = do, d' k = ^a\ + b 2 k = d k , cj) k = tan~\a k /b k ) = c/) k + n/2 

(P2.2.7b) 

The magnitude ratios among the leading three frequency components of 
the input and output are 

input: |Vf ) | : |Vf 5 | : |Vf } | = 4:^:^ = 15:5:3 

output: |V^| : |V< 3) | : |V®| = 2.91 : 0.4446 : 0.166 = 15 : 2.3 : 0.86 

This implies that the relative magnitudes of high frequency components 
to low ones become smaller after the input signal passes through the filter. 
This is a piece of evidence that the RC circuit with the capacitor voltage 
taken as the output functions as a lowpass filter. 

(b) Find the Fourier analysis results on V^’s and V®’s for k = 0 : 5 
(and compare them with those obtained from PSpice simulation in (a)) by 
completing and running the following MATLAB program “sig02p_02.m”, 
which uses the MATLAB function “Fourier analysis!)” declared as 

function [yt,Y,X]= Fourier_analysis (n, d, xgg||iN) 

This function takes the numerator (n) and denominator (d) of the transfer 
function G(s), the (periodic) input function (x) defined for at least one 
period [—P/2, +P/2], the period (P), and the order (N) of Fourier analysis 
as the input arguments and produces the output (yt) for one period and the 
sine-and-phase form of Fourier coefficients Y and X of the output and 
input (for k = 0,..., N). 
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2.3 CTFT (Continuous-Time Fourier Transform) of a Periodic Function 

In Eq. (2.3.1), we gave up computing the Fourier transform of a periodic 
function e ikcoot : 

e ik(0a, e- jw, dt = f e~ Ka, ~ kmo) 'dt 

1 \ T 1 / i(v-kati)T \ I 

—j(co — kcoo) I -t —j(co — kcoo) V /lr=oo 


2sin(o> — kwo)T 
, —(a> - kcoo) 


(P2.3.1) 
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Instead, we took a roundabout way of finding the inverse Fourier transform 
of 2nS(co — kcoo) in expectation of that it will be the solution and showed the 
validity of the inverse relationship. Now, referring to Eq. (E2.6.2) or using 
Eq. (1.1.33a), retry to finish the derivation of Eq. (2.3.2) from Eq. (P2.3.1). 
2.4 Two-Dimensional Fourier Transform of a Plane Impulse Train 

The two-dimensional (2-D) Fourier transform of a 2-D signal f(x, y ) on the 
x-y plane such as an image frame is defined as 

F{u,v) = F 2 {f{x,y)} = J J f{x,y)e~ j(ux+vy) dxdy 

— J f(x,y)e~ Jux dx S j e~ Jvy dy (P2.4.1) 

where x and y are the spatial cordinates and u and v are the spatial angular 
frequencies [rad/m] representing how abruptly or smoothly f(x, y) changes 
w.r.t. the spatial shift along the x and y -axes, respectively. 

(a) Show that the 2-D Fourier transform of f(x, y) = 8(y — ax ) is 



as depicted in Fig. P2.4(b). 

2.5 ICTFT (Inverse Continuous-Time Fourier Transform) of U 0 (jco) = 1 /jco 
Using Eq. (E2.3.3), show that the ICTFT of U 0 (jco) = 1 /jco is the odd 
component of the unit step function: 
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F~\U 0 {jco)} (2 '= lb) j- f —e ja ‘ dco - ^sign(t) = u„(f) (P2.5.1) 

2?r J.oo jco 2 

which agrees with Eq. (E2.8.5). 

2.6 Applications and Derivations of Several Fourier Transform Properties 

(a) Applying the frequency shifting property (2.5.7) of Fourier transform to 
Eq. (E2.7.1), derive Eq. (2.3.2). 

(b) Applying the duality relation (2.5.9) to the time shifting property (2.5.6) 
of Fourier transform, derive the frequency shifting property (2.5.7). 

(c) From the time-differentiation property (2.5.7) of Fourier tansform that 
differentiation in the time domain corresponds to multiplication by jco 
in the frequency domain, one might conjecture that integration in the 
time domain corresponds to division by jco in the frequency domain. 
But, Eq. (2.5.18) shows that the Fourier transform of /_ x(r)dr has an 
additional impulse term reflecting the DC or average value of x(t). Can 
you apply the time-differentiation property to Eq. (2.5.18) to derive the 
original Fourier relation ^'{x(t)} = X(co)7 


(d) Applying the duality relation (2.5.9) to the convolution property (2.5.11) 
of Fourier transform, derive the modulation property (2.5.14). 

(e) Apply the time-differentiation property to the time-integration property 
(2.5.18) to derive the original Fourier relation j r {x(r)J = X(oj). 

(f) Applying the time-differentiation property (2.5.7) to the time-domain 
input-output relationship y(t) = dx(t)/dt of a differentiator, find the 
frequency response of the differentiator. 

(g) Applying the time-integration property (2.5.18) to the time-domain input- 
output relationship y(t) = f_ oc x(j)dx of an integrator, find the frequency 
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response of the integrator on the assumption that the input has zero 
DC value. 

(h) Find the time-domain and frequency-domain input-output relationships of 
a system whose impulse response is g(t) = 8(t — to). 

2.7 Fourier Transform of a Triangular Pulse 

Applying the convolution property (2.5.11), find the Fourier transform of a 
triangular pulse DX D (t) (Eq. (1.2.25a)) obtained from the convolution of two 
rectangular pulses of height 1 and duration D. 

2.8 Convolution/Modulation Properties of Fourier Series 

Let xp(t) and yp(t) be periodic functions with common period P that have the 
following Fourier series representations, respectively: 

*p ( o = ^£2^ **«'*"* and Mt) = 7 Jl'Z$i Ykeibw 

(P2.8.1) 

(a) The periodic or circular convolution of two periodic functions is defined as 

lp(t) = x P {t)* y P (t) (2 '= 2) J x P {T)y P {t - x)dx 

= J yp(r)x P (t - x)dx = y P (t ) * x P (t) (P2.8.2) 

The product of the two Fourier series coefficients X k and Y k is the Fourier 
series coefficients of this convolution so that 

zp(t) = i J2Z-00 Zkeik<O0t = ^ 2X-00 XkYkejkW0> (P2 - 8 - 3) 

Applying the frequency shifting property (2.5.7) of Fourier transform to 
Eq. (E2.7.1), derive Eq. (2.3.2). 

(b) Show that the Fourier series coefficients of ibp(t) = xpit)yp(t) are 

wp(t) = xp(t)yp(t) F °"'^ nCS W k =j } J2Z-oo Xn Yk ~ n (P2 - 8 ’ 4) 
so that we have 

Wp(.t) = j J2Z-oo (P2 - 8 ’ 5) 

2.9 Overall Input-Output Relationship of Cascaded System 

Consider the systems of Fig. P2.9 consisting of two subsystems connected in 
cascade, i.e., in such a way that the output of the previous stage is applied to 
the input of the next stage. Note that the overall output y(t) can be expressed 
as the convolution of the input x(t) and the two subsystem’s impulse responses 
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gi(0 and g 2 (t) as 

y(t) = SiiO * g 2 (t ) * x{t) = g 2 {t) * gxit) * x(t). (P2.9.1) 

Find the overall input-output relationship in the frequency domain. 

(a) x(t)— \ Gi 

Fig. P2.9 

2.10 Hilbert Transform and Analytic Signal 

(a) Fourier Transform of Hilbert Transformed Signal 

The Hilbert transform of a real-valued signal x(t) is defined as the convo¬ 
lution of x(t) and 1 /ret or equivalently, the output of a Hilbert transformer 
(with the impulse response of hit) = 1 /nt) to the input xit): 

xit) = hit ) * xit) = — * xit) = - [ x(r) dr (P2.10.1) 
7 rt jr J -oo t - r 

- First, let us find the Fourier transform of hit) = l/nt by applying the 
duality (2.5.9) to Eq. (E2.8.5), which states that 

1 T 1 duality 1 f 

-sign it) — «*( ) (P2.10.2) 

2 jo) jt 

- We can multiply both sides by j/n to get the Fourier transform of 
hit) = 1 /nt as 

— 4( ) (P2.10.3) 

nt 

- Now, we apply the convolution property to get the Fourier transform of 

m as 

Xf) = ~ * X it) convoIuti ^ property 

T Fixit)) = i ) Xico) (P2.10.4) 


(C) x(t) -» ]GiG 2 | -- y(t) 

M G i I—^y(f) 


This implies that the Hilbert transform has the effect of shifting the 
phase of positive/negative frequency components of xit) by —90°/ + 90°, 
allowing the Hilbert transform a —90° phase shifter. 
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(b) Inverse Hilbert Transform 

Note that multiplying —H(co) by the Fourier transform of the Hilbert 
transformed signal x(t ) brings the spectrum back into that of the original 
signal x(t ): 

— H(cd)H(cd) X(co) = —(—j sign (co))(—j sign(co)) X(co ) = X(co ) 

(P2.10.5) 

This implies the inverse Hilbert transform as 

(■ -h(t))*x(t) *.*(0 = x(t) (P2.10.6) 

(c) Analytic Signal 

The analytic signal, or analytic representation, of a real-valued signal x(t) 
is defined as 

x a (t) = x(t) + jx(t) (P2.10.7) 

where Jc(?) is the Hilbert transform of x(t) and j is the imaginary unit. 
Show that the Fourier transform of the analytic signal is 

X a (co) = f{x(t)} + jf{x(t)} = 2 u s (co)X(co) (P2.10.8) 

where u s (co) is the unit step function in frequency a>. This implies that 
x a (t ) has only nonnegative frequency component of x(t). 

(d) Examples of Hilbert Transform and Analytic Signal 
Show that the following Hilbert transform relations hold: 

cos(co c t) -o- sin(<w c t) (P2.10.9) 

sin(<o c t) —cos (oo c t) (P2.10.10) 

In general, it would be difficult to get the Hilbert transform of a signal x(t) 
directly from its definition (P2.10.1) and therefore, you had better take the 
inverse Fourier transform, X(cd), of x(t), multiply — j sign(cu), and then 
take the inverse Fourier transform as 

x(t) = sign(cu)X(«)} (P2.10.ll) 

Now, let us consider a narrowband signal 

s(t) = m(t) eos(&j c f + <p) with m{t) : a baseband message signal 

(P2.10.12) 

whose spectrum is (narrowly) bandlimited around the carrier frequency 
w c . Show that the Hilbert transform of s(t) is 
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s(t) = m(t) cos(o > c t + 4>) *+ s(t ) = m{t) sin(co c t + (j>) (P2.10.13) 


Also, show that the analytic signal for s(t ) can be expressed as 

s a (t) = s(t) + js(t) = m(t (P2.10.14) 


This implies that we can multiply the analytic signal by e~ jo>ct to obtain 
the envelope of the baseband message signal m(t). 

(e) Programs for Hilbert Transform 

One may wonder how the convolution in the time domain results in just 
the phase shift. To satisfy your curiosity, try to understand the following 
program “sig02p_10e.m”, which computes the output of a Hilbert trans¬ 
former to a cosine wave cos w c t with co c = tt/ 16 and sampling interval 
T s — 1/16 [s]. For comparison, it uses the MATLAB built-in function 
“hilbert ( ) ” to generate the analytic signal and take its imaginary part 
to get x(t). 


(cf.) “hilbert ( )” makes the Hilbert transform by using Eq. (P2.10.11). 



In the program “sig02p_10e.m”, identify the statements performing the 
following operations: 

- The impulse response of the Hilbert transformer 

- Generating an input signal to the Hilbert transformer 
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- Computing the output expected to be the Hilbert transformed signal 
Note the following: 

- The output sequence has been advanced by Nh/2 for comparison 
with x(t) obtained using “hilbert ( )” because the real output of 
the causal Hilbert transformer is delayed by Nh/2, which is the length 
of the noncausal part of the Hilbert transformer impulse 
response h(n). 

(f) Application of Hilbert Transform and Analytic Signal for Envelope 
Detection 

To see an application of Hilbert transform and analytic signal, consider 
the following narrowband signal 


s(t) = m(t)cos(« e t + <j>) 


— sine I —t I cos (oo c t -\ -) with B = 100, i 


= 400tt (P2.10.15) 



Referring to the above program “sig02p_10f.m”, use the MATLAB func¬ 
tion “hi lbert ( ) ” to make the analytic or pre-envelope signal s a (t), 
multiply it by e~ jWct to get the lowpass equivalent or complex enve¬ 
lope si{t), take its absolute values |s;(t)| to obtain the envelope of the 
baseband message signal m(t), and plot it to compare with m(t) = 
| sine (2 Bt) |. 

(g) Hilbert Transform with Real-Valued Signals for Signal Detection 

Consider the system of Fig. P2.10 where a narrowband signal x(t) having 
in-phase component x c (t) and quadrature component x s (t) is applied as 
an input to the system: 

x(t) = x c {t) cos co c t — x s (t) sinco c t (P2.10.16) 

Verify that the two outputs of the system are the same as x c (t) and x s (t), 
respectively by showing that their spectra are 


X c _ d (oj) = X c (a>) and X,_ d (oj) = X s (co) 


(P2.10.17) 
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multiplier summer 



Fig. P2.10 


Complete and run the following program “sig02p_10g.m” to check if these 
results are valid for 

Xc(t) = sine (lOOt), x s (t) = sine (450?), and co c = 4007? 

Does the simulation result show that x c ^(?) = x c (t) and x s d(t) = x s (t )? 
If one of them does not hold, figure out the reason of the discrepancy. 


%sig02p_10g.m 

% To use the Hilbert transform for signal detection 
deafer elf; 

Ts=0.0002; t=[-127:128]*Ts; % Sampling Period and Time interval 
fc=200; wc=2*pi*fc; % Center frequency of signal x(t) 

Bl=l00*pi; B2=45fl*.pi; % Bandwidth of sig&fl x(t) 
xc= sine(Bl/pi*t); xs= sine(B2/pi*t); 

xh= imag(MSbert (x)); .% iittag(x (t) + j x* (t) )-x" (t) 

xc_d= x.*cos(wc*t) + xh.*?????????; % ie-deteggied 
xs_d= -X. *sin (wc*t) + xh. *????'?????; % xc_detected 
subplot (22.1? > plot (t, xe, xc d, Jr') 
subplot (222) , plot(t,xs, t,xs_d,'r') 


2.11 Spectrum Analysis of Amplitude Modulation (AM) Communication System 
Consider the AM communication system of Fig. P2.11(a) where the message 
signal x(t) is band-limited with maximum frequency w x and the spectrum 
X(o)) is depicted in Fig. P2.11(b). Assume that the frequency response of the 
(bandpass) channel is 


H(a>) = 


|o 


for \co - co c \ < Bd 2 
elsewhere 


with B c > 2co x 


(P2.11.1) 


and that of the LPF (lowpass filter) at the receiver side is 
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message ... ”“if r «[»],[( —jf V» 
signal *<'> 'f | «H | f 

carrier signal cos u> c t ideal 2cos ui c t 

(a) The block daigram of an AM communication system 



-u) x o w x 

(b) The spectrum of the message signal x(t) 


X m M = RM 



(c) The spectrum of the modulated, transmitted, and received signal r{t) 



-2uj c 0 2 ( 


(d) The spectrum of the demodulated signal x d (t) 
DM I 


0 

(e) The spectrum of the detected signal d{t) 

Fig. P2.ll An amplitude-modulation (AM) communication system 

G(oj) = \ 1 for l° J l < Br with o x c b r < 2co c - co x (P2.11.2) 
10 elsewhere 

(a) Express the spectrum, X d (w), of the demodulated signal x d (t) in terms of 
X(co). 

(b) Draw the spectra of the modulated and received signal r(t), the demod¬ 
ulated signal x d (t), and the detected signal d(t) on Fig. P2.11(c), (d), 
and (e). 

(c) Complete and run the following program “sig02p_l l.m” to simulate the 
AM communication system depicted in Fig. P2.11(a). Note that the spec¬ 
trum of each signal is computed by using the MATLAB built-in function 
“fft ()” instead of CTFT (Continuous-Time Fourier Transform) since 
DFT (Discrete Fourier Transform) is applied to any sequence (consisting 
of sampled values of an arbitrary continuous-time signal), while CTFT 
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can be applied only to continuous-time signals expressed by a linear 
combination of basic functions. DFT and “fft ()” will be introduced 
in Chap. 4. 


%sig02p_ll.m 

% AM (amplitude-modulation) communication system 

Ts=0.0001; t=[-127:128]*Ts; % Sampling Period and Time interval 
fc=1000; wc=2*pi*fc; % Carrier frequency 
B=1000; % (Signal) Bandwidth of x(t) 

x= sine(B/pi*t)."2; % a message signal x(t) having triangular spectrum 

xm= x.*cos(wc*t); % AM modulated signal 

r= xm; % received signal 

xd= r.* (2*?????????); % demodulated signal 

Br=wc/2; % (System) Bandwidth of an ideal LPF 

g= Br/pi*sinc(Br/pi*t); % (truncated) Impulse Response of the ideal LPF 
d= conv(xd,g)*Ts; % the output of the LPF to the demodulated signal 
subplot(421), plot(t,x), title('A message signal x(t)') 


w= [-Nfft/2:Nfft/2]*(2*pi/Nfft/Ts); % Frequency vector 
X= fftshift(fft(x)); X=[X X(1)]; % Spectrum of x(t) 
subplot(422), plot(w,abs(X)), title('The spectrum X(w) of x(t)') 
subplot(423), plot(t, xm), title('The modulated signal xm(t)') 

Xm= fftshift(fft(xm)); Xm=[Xm Xm(l)]; % Spectrum of modulated signal 
subplot (424), plot(w,abs(Xm)), title('The spectrum Xm(w) of xm(t)') 
subplot(425), plot(t,xd), title('The demodulated signal xd(t)') 

Xd= fftshift(fft(xd)); Xd=[Xd Xd(l)]; % Spectrum of demodulated signal 
subplot(426), plot(w,abs(Xd)), title('The spectrum Xd(w) of xd(t)') 
d= d(Nfft2+[0:Nfft-l]); 

subplot(427), plot(t,d), title('The LPF output signal d(t)') 

D= fftshift(fft(d)); D=[D D (1)]; % Spectrum of the LPF output 
subplot(428), plot(w,abs(D)), title('The spectrum D(w) of d(t)') 


2.12 Amplitude-Shift Keying (ASK) and Frequency-Shift Keying (FSK) 


(a) Amplitude-Shift Keying (ASK) or On-Off Keying (OOK) 

Find the spectrum Xask(cd) of a BASK (binary amplitude-shift keying) 
or OOK modulated signal xaskO) = r D (t ) cos(«it) (Fig. P2.12(a)) where 
r D (t) is a unit-height rectangular pulse with duration D. 

(b) Frequency-Shift Keying (FSK) 

Find the spectrum X FSK (w ) of a BFSK (binary frequency-shift keying) 
modulated signal XfskO) = r D (t) cos(coit) + r D (t — D) cos(&J2(? — D)) 
(Fig. P2.12(b)). 
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r D (f) cos(iV) 

(a) A BASK or OOK signal 

Fig. P2.12 


V D (f-D)cos(w 2 (f-D))' 


2.13 Autocorrelation/Crosscorrelation Theorem 

Suppose we have X(co) = jF{x(t)}, Y{a>) = F{y{t)}, and G(oj) = F{g{t)}, 
where x(t), y(t), and g(t) are the real-valued input, output, and impulse 
response of an LTI system G so that 

y(t) = g(t) * x(t) 4 Y(co) = G(w) * X(co) (P2.13.1) 

(a) Prove the autocorrelation theorem: 

$„(cu) = ^{</>x,(f))' L = 2a V{x(f)*x(-f)j = \X(a>)\ 2 
(Energy Density Spectrum) (P2.13.2) 

(b) Prove the crosscorrelation theorem: 

<&*,(«) = n4> xy (t)f A = &) Hx(t) * y(-t)} 

- X(co)Y*(co) = G*(co) \X((o)\ 2 (P2.13.3) 


(c) Prove that 

<J>3 F{y{t) * >■*(-?)} = Y(oj)Y*(oj) 

= |G(cn)| 2 |X(<u)| 2 (P2.13.4) 

2.14 Power Theorem - Generalization of Parseval’s Relation 

Prove the power theorem that, with X(w) = lF{x(t)) and Y(co) = JC{y(t)}, 
we have 




2.15 Eigenfunction 

If the output of a system to an input is just a (possibly complex-valued) con¬ 
stant times the input, then the input signal is called an eigenfunction of the 
system. Show that the output of an LTI (linear time-invariant) system with the 
(causal) impulse response g(t) and system (transfer) function G(s) = £{g(t)} 
to a complex exponential input e s °‘ is, 
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G{e *»'} = g(t) * e s «* = G(s 0 )e s °' with G(s 0 ) = G(s)|, =So (P2.15.1) 

where G(s ) is assumed not to have any pole at s = so so that the ampli¬ 
tude factor G(so), called the eigenvalue, is finite. This implies that a complex 
exponential function is an eigenfunction of LTI systems. 

2.16 Fourier Transform of a Polygonal Signal (Problem 4.20 of [0-1]) 

(a) Show that the Fourier trnasform of y(t) = {at + b){u s (t — t{) — u s {t — 1 2 )) 
with t\ < t 2 is 

Y(ja>) = ^ 2 {a+jbco){e ^-e "'">)+/(t,e jm, *-t 2 e ^') (P2.16.1) 

(b) We can describe a triangular pulse having three vertices 0), (fi, x,), 
and (t i+ \, 0) as 



(a) A signal and its polygonal approximation (b) A trapezoidal signal 

Fig. P2.16 


Use Eq. (P2.16.1) to show that the Fourier transform of this pulse is 

(P2.16.3) 

(c) Fig. P2.16(a) shows a finite-duration signal x(t) and its piece-wise linear 
or polygonal approximation xp{t) where x(t) = xp(t) = 0 V? < to and 
t > t n . Use Eq. (P2.16.3) to show that the Fourier transform of xp(t) is 

X P {co) = F{x P {t)} = ^)E” = o ;w(0 l = i H n i = 0 k * e ~ jCO,i ( p2 - 16 - 4 ) 
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where 


0,_1 — ti)x i+ 1 + {tj — t i+ \)Xi-\ + (t,+;| — 

ki — -and 

(ft - ti- i)ft-+i - h) 

x(J_i) = x(t n+ 1) = 0 

Complete the following program “CTFT_poly ()” so that it implements 
this method of computing the Fourier transform. 


function [X, w] =CTFT_poly (t, x, w) 

% Computes the CTFT of x(t) for frequency w by using Eq.(P2.16.4) 



(d) For the trapezoidal signal z(t) shown in Figure P2.16(b), find its Fourier 
transform Z(co) in two ways: 


(i) Regarding z,(t) as the convolution of two unit-height rectangular 
pulses each of length D\ = T 2 — T\ and D 2 = T 2 + T u you can 
use the convolution property (2.5.11) together with Eq. (E2.3.2). 

(ii) Use Eq. (P2.16.4), which is the result of part (c). 

(iii) Use the MATLAB routine “CTFT poly ()” to get Z(oj) = !F{z(t)} 
with T\ = 1 and T 2 = 2 and plot it to compare the result with that 
obtained (i) or (ii). 

<Hint> You can complete and run the following program. 


tsi0O2t>_16 .m 

% Numerical approximation of CTFT for a trapezoidal signal 
clear, elf 

t= [-T2 -Tl Tl T2] ; 
x= [0 T2-T1 T2-T1 0]; 

w= [-200:200]/100*pi+le-6; % frequency range on which to plot X(w) 
X= Dl*D2*sinc(w*Dl/2/pi).*sinc(w*D2/2/pi); 

Discrepancy=norm (X_poly-X) 

plot (w, abs (X) ,' b', w, abs (X_poly) r') 


(e) Show that, if we choose the points tC s sufficiently close together so that 
the piecewise linear approximation, xp(t), of x(t) is accurate enough to 
satisfy the bounded error condition 
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|x(f) - JCpMI < S, (P2.16.5) 

then the Fourier transform (Eq. (P2.16.4)) of Xp(t) is close to X(oj) — 
T\x(t )} enough to satisfy 

J \X(w) - X P (co)\ 2 d(o < 2n{t n - t 0 )s 2 (P2.16.6) 

(cf.) This implies that even though a signal x(t) cannot be expressed as a 
linear combination, a multiplication, or convolution of basic functions, 
we can find its approximate Fourier transform from the collection of 
sample values of x(t) and that we can improve the accuracy by making 
the piecewise approximation xp(t ) closer to x(t). 

(cf.) This result suggests us that it is possible to evaluate numerically the 
Fourier transform for a finite-duration signal whose values are mea¬ 
sured experimentally at many (discrete) time instants, even though the 
closed-form analytic expression of the signal is not available or too 
complicated to deal with. 

2.17 Impulse Response and Frequency Response of Ideal Bandpass Filter 

Consider a sine function multiplied by a cosine function, which is depicted in 
Fig. P2.17: 


Fig. P2.17 




(a) Using Eqs. (E2.9.1&2) and the amplitude modulation (AM) property 
(E2.12.3), find the Fourier transform G(co) = !F{g{t)} and sketch it. 

(b) If Eq. (P2.17.1) describes the impulse response of a system, which type 
of filter is it? 

(Lowpass, Bandpass, Highpass, Bandstop) 

2.18 Design of Superheterodyne Receiver - Combination of Tunable/Selective 
Filters 

We can build a tunable selective filter, called the superheterodyne or super¬ 
sonic heterodyne receiver often abbreviated superhet ), by combining a tun¬ 
able, but poorly selective filter, a highly-selective, but untunable filter having 
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a fixed IF (intermediate frequency) passband, a mixer (multiplier), and a local 
oscillator as shown in Fig. P2.18.1. 

Suppose the input signal y(t) consists of many AM (amplitude modulated) 
signals which have been frequency-division-multiplexed (FDM) so that they 
each occupy different frequency bands. Let us consider one signal yi (t) = 
xi(t)cosco c t with spectrum Y\(co) as depicted in Fig. P2.18.2(a). We want to 
use the system of Fig. P2.18.1 to demultiplex and demodulate for recovering 
the modulating signal x\ (t), where the coarse tunable filter has the frequency 
response H c (a>) shown in Fig. P2.18.2(b) and the fixed frequency selective 
filter is a bandpass filter (BPF) whose frequency response Hf(oj) is centered 
around fixed frequency co c as shown in Fig. P2.18.2(c). 



Fig. P2.18.1 Superheterodyne receiver - tunable and selective filter 


y,(u>) 



(b) The frequency response of the coarse tunable filter 

H f [w) 



(c) The frequency response of the fixed selective filter 

Fig. P2.18.2 


(a) What constraint in terms of co c and com must cot satisfy to guarantee that 
an undistorted spectrum of x\(t) is centered around coy so that the output 
of the fixed selective filter Hf can be v(t) = x\(t) cos co ft? 
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(b) Determine and sketch the spectra R(oj), Z(co), V (&>), and D(co) of the 
output r(t) of the coarse tunable filter H c , the input z(t) and output v(t) of 
the hxed selective hlter Hf, and the output d(t) of the LPF. 

(c) How could you determine the gain K of the fixed selective filter Hf 
required to have v(t) = x\(t) cos co/t at its output? 

(d) Complete and run the following program “sig02p_18.m” to simulate the 
superheterodyne receiver twice, once with kT = 18 and once with kT = 
19. Explain why the two simulation results are so different in terms of the 
error between d(t ) and x\(t). Note that the parameters kc, kf, kM, and kT 
correspond to co c , o)f, com, and cot, respectively. 
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2.19 The Poisson Sum Formula (PSF) and Spectrum of Sampled Signal 

Consider an LTI (linear time-invariant) system with impulse response h(t ) 
and frequency response H(jw ) = !F{h(t)}. Note that the response (output) 
of the system to the impulse train can be expressed in terms of the impulse 
response as 

S(t) h(t)\ S T (t ) = _ x W ~ nT ) ^ _oo h( J ~ (P 2 - 19 - 1 ) 

Likewise, the response (output) of the system to a single or multiple complex 
exponential signal can be written as 

e jk<oot £H H(jkwo)e jkmt. }_ ^ e jkaot ^ Y YZ-oo HUk(0 ° )ejk(O0t 

(P2.19.2) 

(a) Based on the above results (P2.19.1) & (P2.19.2) and Eq. (2.1.10), prove 
that, for any function h(t) with its Fourier transform H(jco) = tF{h(t)} 
well-defined, the following relation holds: 
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El. k(t ~ nT ^=\ EH-oo H(jkc °° )eik<oot wi * ^=t 

(P2.19.3) 

which is called the Poisson sum formula. 

(b) Using the Poisson sum formula, prove the following relation pertaining to 
the spectrum of a sampled signal (see Eq. (E2.13.3)): 

E„ = _oo x ( nT ) e ~ in<oT = j EH-oo+ kc °o )) with X(/ft)) 

= JE{ x (t)} and co 0 = y (P2.19.4) 


<Hint> Substitute h(t ) = x(t)e J '" ,t and its Fourier transform H(jw) = 
X(j(co + o>i)) with into Eq. (P2.19.3) and then 

substitute t = 0 and = w. 

2.20 BPF (Bandpass Filter) Realization via Modulation-LPF-Demodulation 

Consider the realization of BPF of Fig. P2.20(a), which consists of a modu¬ 
lator (multiplier), an EPF, and a demodulator (multiplier). Assuming that the 
spectrum of x(t) is as depicted in Fig. P2.20(b), sketch the spectra of the sig¬ 
nals x c (t), x s (t), y c (t), y s (t), and v(t) to see to it that the composite system 
realizes a BPF and determine the passband of the realized BPF. 



(a) A BPF realization via modulation-LPF-demodulation 


m 



-6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 
(b) The spectrum of the input signal 


Fig. P2.20 
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2.21 TDM (Time-Division Multiplexing) 

As depicted in Fig. P2.21(a), Time-Division multiplexing (TDM) is to transmit 
two or more PAM (pulse amplitude modulation) signals not simultaneously as 
subchannels (separated in the frequency-domain), but physically by turns in 
one communication channel where each subchannel is assigned a timeslot of 
duration D every T s in such a way that the timeslots do not overlap. Sketch a 
TDM waveform of two signals Xi(t) and x 2 (t) in Fig. P2.21(b). 



(a) A TDM communication system (b) A time-division multiplexed signal 


Fig. P2.21 TDM (Time-Division Multiplexing) communication 

2.22 FDM (Frequency-Division Multiplexing) 

As depicted in Fig. P2.22(a), Frequency-Division multiplexing (FDM) is to 
transmit two or more SAM (sinusoidal amplitude modulation) signals as sub¬ 
carriers (separated in the frequency-domain) in such a way that the frequency 
slots each carrying a signal (amplitude-modulated with different carrier fre¬ 
quency) do not overlap. Assuming that the channel is ideal so that r(t) = s(t), 
sketch the spectrum of the FDM signal to be transmitted over the same com¬ 
munication channel where the spectra of two signals x\ (f) and X2(t) to be 
frequency-multiplexed are shown in Fig. P2.22(b). 

(cf.) Time/frequency-division multiplexing assigns different time/frequency 
intervals to each signal or subchannel. 

2.23 Quadrature Multiplexing 

Consider the quadrature multiplexing system depicted in Fig. P2.22, where 
the two signals are assumed to be bandlimited, that is, 

Xi((o) = X 2 (w) = 0 for co > com (P2.23.1) 

as illustrated in Fig. P2.23(b). 

(a) Assuming that the channel is ideal so that r(t) = s(t), express the spectra 
S(co), Vi (w), V 2 ((o), Ti(cu), Y 2 (co) of the signals s(t), u,(f), v 2 (t), y,(f), 
and y 2 (t) in terms of X \ (oj) and X 2 (a>). 

(b) Complete and run the following MATLAB program “sig02p 23.m” to see 
if yi(t) = xi(t ) and y 2 (t) = x 2 (t). 







Communication r (/) 



(a) A FDM (Frequency-Division Multiplexing) communication system 
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2.24 Least Squares Error (LSE) and Fourier Series Representation 

Consider a continuous-time function x(t ) on a time interval [ a, b] and a set of 
its sampled values, {x\,x-i, • • • , x;v} (with x n = x(t n )). Let us find an approx¬ 
imate representation of x(t) as a linear combination of some basis functions 
{4> k (ty,k=l:K}: 

x(c, t) = ^ j c k for a < t < b (P2.24.1) 

where the coefficient vector c = [c\ c-i - ■ ■ c K ] r is to be determined so that the 
following objective function can be minimized: 


E 2 (c) = J {x(t)-x{c,t)) 2 dt (P2.24.2) 

£ 2( c) = ~ i(c. t n )) 2 (P2.24.3) 

The following notations will be used: 

x = [x | x 2 ■■■ x n ] t with x n = x(t n ) (P2.24.4a) 

c = [ci c 2 • • • c K f (P2.24.4b) 

<p(t) = [Mt) Ut) ■ ■ ■ 4>K(t)l T (P2.24.4c) 


s = [ei e 2 • • • s n ] t 


(P2.24.4d) 
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with s„ - 

= x„- x(c, t, 

i) = x n - c k <t> k (t n ) = x„- (p r (t„)C 


~ (h)~ 


011 021 • 0m 



<P r fe) 


012 022 • 0m 


$ = 

• 

= 

• • • • 

with 0jt„ = <pk(t n ) (P2.24.4e) 


• 


• • • • 



_<p T {t N )_ 


_01JV 02JV • <j>KN_ 



Based on these notations, the above objective function (P2.24.3) can be 
written as 


E 2 { c) = e* r e = [x* - 4>*c*] r [x - <J>c] 

= x* r x — x* T <J>c — c* r <b* r x + c* r <J>* r <J>c 
= x* T [/ - 0[<b* r $]- 1 0* r ] x 

+ [$ r O*c* - $ 7 'x*] r [0* r <I>]- 1 [$* 7 ’$c - <b* r x] (P2.24.5) 

where only the second term of this equation depends on c. Note that this 
objective function is minimized for 

0* r 0c — 4>* r x = 0 (a normal equation); c = [0* r 4>] _1 <h* r x (P2.24.6) 

(a) Let the K functions {<pk(t), k = 1 : K } constitute an orthogonal set for 
the N discrete times {t n , n = 1 : N) in the sense that 

Y^ n=1 <t>ln<t>mn = OWk^m (P2.24.7) 

so that is diagonal. Show that the coefficients can be deter¬ 

mined as 


c t = 1" =1 nVkn , for k = 1,2, • • • , K (P2.24.8) 

El:, (P* k jkn 

Likewise, if the K functions \4>k(t)- k — 1 : K] constitute an orthogonal 
set for the continuous time intrerval [a, b ] in the sense that 


J <P*k(t)<p m (t) dt = 0Vk^n 
then the coefficients can be determined as 
f b x(t)<pi(t) dt 

c k = J ft - — - , for k = 1, 2, • • • , 

fa 0i(O0i(O dt 


(P2.24.9) 


(P2.24.10) 
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(b) Using Eq. (P2.24.1), find an approximate representation of a real-valued 
function x(t) for — P/2 < t < P/2 in terms of the following basis 
functions 


<p k (t) = —e iko)0 ‘ with « 0 = — and k =-K : K (P2.24.ll) 
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In this chapter we study the discrete-time Fourier analysis techniques, i.e., the 
DTFT (Discrete-Time Fourier Transform), DFT (Discrete Fourier Transform), and 
DFS (Discrete Fourier Series) of a discrete-time sequence, which will be used to 
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3 Discrete-Time Fourier Analysis 


describe and analyze the frequency characteristics of discrete-time signals and the 
frequency-domain behavior of discrete-time systems. We also deal with the fast 
Fourier transform (FFT), which is a very efficient algorithm for computing the DFT. 

Each of the continuous-time and discrete-time Fourier techniques has its own 
application in the sense that they are used for analyzing continuous-time and 
discrete-time signals/systems, respectively. However, if you do not understand then- 
organic inter-relationship beyond some similarity, you will miss the overall point 
of viewing the frequency characteristic of signals/systems and get only a confusing 
impression that there are too many Fourier techniques. Basically, we want to find, 
say, the CTFT of continuous-time signals since no inherently discrete-time signals 
exists in the physical world. However, the DFT, implemented by the FFT algorithm, 
of discrete-time signals obtained by sampling continuous-time signals is the only 
one practical Fourier analysis technique because of its outstanding computational 
convenience compared with the CTFT that is difficult to compute for general sig¬ 
nals. That is why we need to know the relationship between the CTFT and DFT and 
ultimately, be able to get the “true” information about the frequency characteristic 
of a (continuous-time) signal from its FFT-based spectrum. 


3.1 Discrete-Time Fourier Transform (DTFT) 

3.1.1 Definition and Convergence Conditions of DTFT 
Representation 

As the discrete-time counterpart of the CTFT (continuous-time Fourier transform) 
X(jco) = F{x(t)} U = la) J x(t) e~ J0> ' dt 
we define the Fourier transform of a discrete-time sequence x[n] as 

X(jn) = X[e jn ] = Hx[n]} = (3.1.1) 

which is called the DTFT ( discrete-time Fourier transform ). From now on, we will 
more often use X(£2) than X(jQ) or X[e jil | for simplicity. Let us see the physical 
meaning of the DTFT. 

Remark 3.1 Physical Meaning of the DTFT - Signal Spectrum and Frequency 
Response 

(1) If a sequence x[n] represents a physical signal, its DTFT X(Q.) = !F{x[ri]} 
means the signal spectrum, which describes the frequency contents of the signal. 

(2) In particular, if a time function g[n] represents the impulse response of a 
discrete-time LTI (linear time-invariant) system, its DTFT G(Q) = iF{g[n]} 
means the frequency response, which describes how the system responds to a 
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sinusoidal input sequence of digital (angular) frequency £1 (refer to Sect. 1.2.6 
for the definition of frequency response). 

One striking difference of the DTFT from the CTFT is its periodicity (with period 
2n) in the (digital) frequency variable O, which results from the fact that it is a 
function of e jn periodic with period 2tt in £2, i.e., e j(a+l7T " > — e' a . Based on the 
periodicity of the DTFT, we are going to use the CTFS (for periodic functions) to 
derive the IDTFT ( inverse discrete-time Fourier transform) formula. To this end, we 
can use Eq. (2.1.5a) with P = 2n, coq = 2n/P = 1, t = £2, and k — — n to write 
the (continuous-frequency) Fourier series representation of X(Q) as 




where the Fourier coefficients are 


<2 = b) ^ ^ J X(Q) e ’ a " dQ (the integral over one period of length 2n) 

(3.1.2b) 


Noting that Eq. (3.1.2a) is the same as Eq. (3.1.1) multiplied by a scaling factor 
1/27T, we can multiply Eq. (3.1.2b) by the same scaling factor 1/27T to write the 
IDTFT formula as 


x[n] - JF- 1 {X(f2)} = — [ X(Q)e jan dQ. (3.1.3) 

2 7t J 2n 

We call Eqs. (3.1.1) and (3.1.3) the DTFT pair where Eq. (3.1.1) is the analysis 
equation and Eq. (3.1.3) is the synthesis equation. 

Like the convergence conditions (2.2.2a) and (2.2.2b) for the CTFT, it can be 
stated that the DTFT will exist if the sequence x[n] has finite energy, i.e., 

^H-oo I 2 < 00 (3.1.4a) 


or if it is absolutely summable, i.e., 

E:_J^ ]|< o° (3.1.4b) 

Remark 3.2 Frequency Response Existence Condition and Stability Condition of a 
System 

Note that, for the impulse response g\ri\ of a discrete-time LTI system, the 
absolute-summability condition (3.1.4b) is identical with the stability condition 
(1.2.27b). This implies that a stable LTI system has a well-defined frequency 
response G(Q) = JF{^[n]}. 
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3.1.2 Examples of DTFT Analysis 

Example 3.1 DTFT of a Rectangular Pulse Sequence 

For the rectangular pulse of duration 2M +1 from —MtoM shown in Fig. 3. l(al) 
and described by 


r' 2M+l [n] = u s [n + M] - u s [n - M - 1] (E3.1.1) 


we can apply Eq. (3.1.1) to get its DTFT as 


— e r 2M+i w e 1 nn 

(E3U.1) M , an (D.23) f nM 1 ~ e~ j n ( 2M + 1 '> 


= E, 


<=-m 1 - e - 

e -j n(2M+l)/2( e j Si(2M+\)/2 _ e -j n(2M+l)/2j 


(Dirichlet kernel) 


_ e -j£i/2( e jQ/2 _ e -7«/2) 

( 022 ) sin(J2(2M + l)/2) 
sin(Q/2) 


whose magnitude and phase are depicted in Fig. 3.1 (bl) and (cl), respectively. 
Likewise, for the rectangular pulse of duration 2 M + 1 from 0 to 2 M shown in 
Fig. 3.1(a2) and described by 



Fig. 3.1 Two rectangular pulse sequences and their magnitude & phase spectra 
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we can apply Eq. (3.1.1) to get its DTFT as 
^ 2 m + i (^) = r. u r 2M+\W e 7 



-j o.m = sin(ft(2M+l)/2) ^ _ ^ 

C sin(f2/2) 

(E3.1.4) 

whose magnitude and phase are depicted in Figs. 3.1 (b2) and (c2), respectively. 

Note the following: 

- In contrast with the continuous-time case (Fig. 2.8(a)), the DTFT of a rectan¬ 
gular pulse sequence is periodic, being no longer a pure sine function, but an 
aliased sine function. Still the magnitude spectra show that the rectangular pulses 
have low frequency components (around £2 = 0) more than high frequency ones 
around ii = ±n. 

- The spectrum (E3.1.2) of an even-symmetric pulse sequence is real-valued and 
its phase is 0 or ±jt depending on whether it is positive or negative. Especially 
for the frequency range such that R' 2M+1 (£2) < 0, we set its phase to +n or —jr 
so that the overall phase curve is odd-symmetric to comply with the conjugate 
symmetry (3.2.4) of DTFT (see Fig. 3.1(d)). 

- Due to the fact that the phase of Rim+\ (£2) (Eq. (E3.1.4)) is proportional to the 
(digital) frequency £2 as —Mi 2, the (shifted) rectangular pulse sequence is said 
to have a linear phase despite the phase jumps (discontinuities) caused by the 
change of sign or the wrapping (modulo 2 n) operation of angle (see the piecewise 
linear phase curve in Fig. 3.1(c2)). 

Example 3.2 DTFT of an Exponential Sequence 

For an exponential sequence e\ [n] = a n u s [n ] with \a\ < 1, we can apply 

Eq. (3.1.1) to get its DTFT as 



(E3.2.2) 
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Fig. 3.2 Four exponential sequences and their magnitude & phase spectra 


Fig. 3.2(al-a2), (bl-b2), and (c2-c2) show the exponential sequences e\[n] = 
a"u s [n\ with a = ±0.5 and ±0.8 and their magnitude and phase spectra. Note 
the following: 

- From Fig. 3.2(al), we see that e\ [«] with a = 0.8 is smoother than that with 
a =0.5. This is reflected in Fig. 3.2(bl) showing that the magnitude spectrum 
\E\ [£2] | with a = 0.8 is larger/smaller than that with a = 0.5 around £2 = 0 (low 
frequency)/ £2 = ±jr (high frequency). Also from Fig. 3.2(a2), we see that e\ [n] 
with a = —0.8 changes more rapidly than that with a = —0.5. This is reflected 
in Fig. 3.2(b2) showing that the magnitude spectrum |£i[£2]| with a = —0.8 is 
larger/smaller than that with a = —0.5 around £2 = ±tz (high frequency)/£2 = 0 
(low frequency). 

- Comparing Fig. 3.2(al) and (a2), we see that e\ [«] with a < 0 changes much 
more rapidly than that with a > 0. This is reflected in that the magnitude 
spectrum |£i[£2]| with a < 0 (Fig. 3.2(b2)) is large around £2 = ±7T (high 
frequency) and that with a > 0 (Fig. 3.2(bl)) is large around £2 = 0 (low 
frequency). 


Example 3.3 DTFT of a Symmetric Exponential Sequence 

For the exponential sequence e2[«] = a 1 " 1 with|a| < 1, we can apply Eq. (3.1.1) 
to get its DTFT as 




Fig. 3.3 Four exponential sequences and their magnitude spectra 


E 2 (£2) = J2Z-OC a ' n ' e ~ jnn = Y2 n Loo a ~ ne ~ jnn 

± j^Zo a " e ~ ian = YZi (ae 7 Q) " + E„: o (ae ~ j fi) " 


1 (1X20) 1 - 


1 — ae ji2 l — a e~ J 


1—2 a cos Q. + a 1 


whose magnitudes with a = ±0.5 and ±0.8 are depicted in Fig. 3.3. 


Example 3.4 DTFT of the Unit Sample (Impulse) Sequence 

For the impulse (unit sample) sequence <5[n], we can apply Eq. (3.1.1) to get its 
DTFT as 


D(Q) = J2Z-oo Sln] e ~ jan = S W e ~ jnn \n=o = 1 (E3A1) 

As with the continuous-time case (Eq. (E2.6.1) in Example 2.6), this implies that a 
discrete-time impulse signal has a flat or white spectrum, which is evenly distributed 
over all digital frequencies. 


(cf.) Very interestingly, applying the IDTFT formula (3.1.3) to (E3.4.1) yields a 
useful expression of the unit sample (impulse) sequence. 


„ r , (3-1.3) 1 f 

* [n] = 


D(£2) e jnn dQ. 




(E3.4.2) 
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(a) The impulse response of an ideal LPF 


p. m p.. . 


3 -B 0 B -2 w-B -2tt+B 
(b) The frequency response of an ideal LPF 


Fig. 3.4 The impulse response and frequency response of an ideal LPF 


Example 3.5 IDTFT of an Ideal Lowpass Filter Frequency Response 

Let us consider the frequency response of an ideal lowpass filter (LPF) depicted 
in Fig. 3.4(b): 


G(Q) _ |l for ^ - 2m7r| < B < n (m : an integer) 5 

1 ^ (0 elsewhere 

We can take the IDTFT (inverse discrete-time Fourier transform) (3.1.3) to get the 
impulse response of the LPF, which is shown in Fig. 3.4(a), as follows: 


g[n] = f- 1 {G(n)} (3 = 3) X f B G(Q)e^ n cm iE = A) — 

2 Tt J_ B (D.33) IjlJTl 

sin(Bn) B (Bn\ 

= -= —sine I - I 


- e ~ jBn ) 
(E3.5.2) 


3.1.3 DTFT of Periodic Sequences 

In analogy with the arguments in Sect. 2.3 for deriving Eq. (2.3.2) as the generalized 
CTFT of continuous-time periodic functions, we begin with applying the IDTFT 
formula (3.1.3) to an impulse train type spectrum 

X(S2) = X!~_oo 2nS ( Q -^0-2* i ) 

to get a complex sinusoidal sequence as 

x[n ] = JF- 1 {X(£2)} (3 = 3) X f X(n)e ian <m 
2n Jin 

= jf <5(f2 - £2 0 ) e j an d£l (1 = 5) e j n ° n 
This implies the following DTFT relation: 
el Qon £ X(tt) = 


27r8(£2 — C2 q ~ 2tz i) 


(3.1.5) 
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Example 3.6 DTFT of a Constant Sequence 

Let us consider a constant sequence c[n] = 1. Noting that this is a kind of 
periodic function obtained by substituting £2o = 0 into the LHS of DTFT relation 
(3.1.5), we can substitute £2o = 0 into the RHS of that DTFT relation to obtain the 
DTFT of c[n ] = 1 as 

c[n] = 1 4 C(£2) = V °° 2jrS(Q - 2n i ) (E3.6.1) 

(3.1.5)with£2 0 =0 *—‘i =-oo 

Example 3.7 DTFT of a Sine/Cosine Sequence 

(a) For sin(£2 0 «) (D =~\e jn ° n — e~ ja ° n )/j2, we use Eq. (3.1.5) to get its DTFT as 

sin(S2 0 n) 4 j: r («(£2 + S2 0 - 2n i ) - S(fi - Q 0 - 2n i)) (E3.7.1) 

(b) For cos(£2 0 n) (I = l) (e ,Q °" + e~ jQ ° n )/2, we use Eq. (3.1.5) to get its DTFT as 

cos(fton) £ 7T (i(£2 + S2 0 - 2 tt0 + 5(£2 - £2 0 - 2jtj)) (E3.7.2) 

Example 3.8 DTFT of the Unit Step Sequence 

Similarly to Example 2.8 for deriving the CTFT of the unit step function, we first 
decompose the unit step sequence u s [n ] into the sum of an even sequence and an 
odd sequence as 

u s [n] = u e [n] + u 0 [n] (E3.8.1) 


where 

Ue |/t] = \{u s [ n] + u s [-«]) = \(l+8 [»]) (E3.8.2) 

Uo [n] = ^(m s [n] - u s [-«]) = ^sign(n) (E3.8.3) 

Then we can take the DTFT of the even and odd parts as 

(E3.8.4) 

U„(S2) = .4!». [»] | = |tF{», W| - T{u, [-»])) 

= \ (El u ~‘°" ~ E,"L. = l El - eia "> 



2(1 — cos £2) 


(E3.8.5) 
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Now we add these two results to obtain the Fourier transform of the unit step 
sequence as 

Hu s [n ]} = l - (^4^ + i-g-yn ) + \ + n £*' vb0 “ 2;r f ) 

= } _ _ . a + 7 r E,Z_oo ~ 2n i} (E3.8.6) 

3.2 Properties of the Discrete-Time Fourier Transform 

As with the continuous-time Fourier transform (CTFT), there are many properties 
of DTFT that provide us with further insight into the transform and can be used 
for reducing the computational complexity associated with it. Noting that there are 
striking similarities with the case of CTFT, we will simply state the properties unless 
their derivations and interpretations differ from those with the continuous-time case. 

3.2.1 Periodicity 

Since the DTFT X(£2) defined by Eq. (3.1.1) is a function of e JQ , it is always 
periodic with period 2n in £2: 

A(Q) = X[e ’ n ] = X(Q, + Imir) for any integer m (3.2.1) 

(cf.) The periodicity lets us pay attention to the DTFT only for its one period, say, 

—Tt < £2 < Tt. 

3.2.2 Linearity 

With Fixiri]} = X(£2) and T{y[n]} = T(S2), we have 

a x[n\ + b y[n] £■ a X(£2) + b T(f2), (3.2.2) 

which implies that the DTFT of a linear combination of many sequences is the same 
linear combination of the individual DTFTs. 


3.2.3 (Conjugate) Symmetry 

In general, the DTFT has the time reversal property: 

Hx[ -n]} (3 = ) ~= m TZ=-oo X[m]e ~ i ^ )m °'= )x{ ~ Q ‘ ) 




(3.2.3) 
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In case x\n] is a real-valued sequence, we have 

12 = d> x[«] e ~^~ j)Qn = X*(£2) (complex conjugate of X(Q)) 

or equivalently, 

Re{X(-£2)} + j Im{X(-£2)} = Re{X(S2)} - j Im{X(£2)}; 

|X(-Q)|ZX(-S2) = |X(£2)|Z - X(£2) (3.2.4) 

This implies that the magnitude/phase of the DTFT of a real-valued sequence is an 
even/odd function of frequency £2. 

Also in analogy with Eq. (2.5.5) for the CTFT, we have 

even and real-valued x e [n] Re{X( £2)} even and real-valued (3.2.5a) 

odd and real-valued x 0 [n] 4 j Im{X(£2)} odd and imaginary-valued (3.2.5b) 

3.2.4 Time/Frequency Shifting (Real/Complex Translation) 

The DTFT has the time-shifting and frequency-shifting properties as 

x[n-m] 4 X(Sl)e~ jani = X(£2)Z-m£2 (3.2.6) 

x[n\e jQ ' n 4 X(£2- £2j ) (3.2.7) 

3.2.5 Real Convolution 

The DTFT has the convolution property 

y[n1 = x[n] * g[n ] 4 T(£2) = X(£2) G(£2) (3.2.8) 

which can be derived in the same way with Eq. (2.5.11). This is very useful for 
describing the input-output relationship of a discrete-time LTI system with the input 
x\n], the output y[n], and the impulse response g[n] where G(Q) = F{g[n]\ is 
called the frequency response of the system. 

3.2.6 Complex Convolution (Modulation/Windowing) 

In analogy with Eq. (2.5.14) for the CTFT, the DTFT also has the complex convo¬ 
lution (modulation) property as 

y[n] = x[n] m[n ] 4 F(£2) = 4- X(£2) * M(£2) 

2 It 2 it 

where * denotes a circular or periodic convolution with period 2tt. 


(3.2.9) 
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Example 3.9 Effect of Rectangular Windowing on the DTFT of a Cosine Wave 
From Eqs. (E3.7.2) and (E3.1.2), we can write the DTFTs of a cosine wave 
x[n] = cos(£2on) and an even rectangular pulse sequence r' 1M+l \n\ of duration 
2M + 1 as 



We can use the complex convolution property (3.2.9) to find the DTFT of a 
rectangular-windowed cosine wave y[ri\ = cos(£2on )r' 2M+l \ri\ as 


7(S2) = DTFT{y[«]} = DTFT{cos( £2 0 n)r' M+1 [n]} 


2 n 2 jt 


- S2 0 — 2jt i ) + <5(£2 — £2 0 — 2 n i )) * 


— ) + ^0 — 27r i) + R' 2m+1 (£2 — £Iq — 2tz i )) 

(B3A2) 1 /sin((£2 + ^-2n i){2M + l)/2) 

2 V sin((£2 + £2 0 - 2n i)/2) 

sin((£2 - ftp - 2;r i)(2M + l)/2) \ 

+ sin((ft - — 2n i)/2j ) 1 ' ' 

which is depicted together with X(£2) (E3.9.1) and R' 2M+i (Q) (E3.9.2) in Fig. 3.5. 
Compared with the spectrum of the cosine wave (Fig. 3.5(bl)), the spectrum 
7(£2) of the rectangular-windowed cosine wave (Fig. 3.5(b3)) has many side lobe 
ripples (with low amplitude) besides the two main peaks, which is interpreted as the 
spectral leakage due to the rectangular windowing. 

Example 3.10 Impulse Response and Frequency Response of an FIR LPF (Lowpass 
Filter) 

We can use Eq. (E3.5.2) to write the impulse response of an ideal LPF with 
bandwidth B = 7t/ 4 as 

(E3.5.2) sin(Ru) I 1 . (n\ 

g[n ] = - =-sine - (E3.10.1) 

ft n lfi=jr/4 ^ V4/ 

which has an infinite duration so that it cannot be implemented by an FIR filter. 
Thus, to implement it with an FIR filter, we need to truncate the impulse response, 
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say, by multiplying the rectangular window 

1 for - 3 < n < 3 
0 elsewhere 



whose DTFT is 


W(S2) 


(E3T.2) sin(7S2/2) 
sin(S2/2) 


Then we obtain the windowed impulse response of an FIR LPF as 


(E3.10.2) 


(E3.10.3) 


gw[n\ = g[n] w[n ] 


(E3.10.4) 


whose DTFT is 

G w {n) (3 = 9) -Lg(SI)* W(fi) (E3.10.5) 

complex convolution property 2 7t 2n 

This is the frequency response of the FIR LPF. Figure 3.6 shows the impulse and 
frequency responses of the ideal and FIR LPFs together with the rectangular window 
sequence and its DTFT spectrum. 


(cf.) Note that the frequency response of the FIR LPF (Fig. 3.6(b3)) has smooth 
transition in contrast with the sharp transition of the frequency response of 
the ideal LPF (Fig. 3.6(bl)). 


We can run the following program “sig03el0.m” to plot Fig. 3.6 and compare the 
two DTFTs of the windowed impulse response gi\n], one obtained by using the 
DTFT formula (3.1.1) or the MATLAB routine “DTFT ()” and one obtained by 
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(a3) FIR LPF impulse response (b3) FIR LPF frequency response 


Fig. 3.6 Effect of windowing on the spectrum or frequency response 

using the circular convolution (E3.10.5) or the MATLAB routine 

“cor.v. circu 1 ar () ”. 
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3.2.7 Differencing and Summation in Time 

As with the differentiation and integration property of the CTFT, the DTFT has the 
following differencing and summation properties: 

x[n] - x[n - 1] 4 (1 - e~ j X(£2) (3.2.10) 

- - X — ^X(£2) + nX(0) Y^—oo “ 2n i} (3 ’ 2 - n) 


3.2.8 Frequency Differentiation 


By differentiating both sides of the DTFT formula (3.1.1) w.r.t. £2, we obtain 


dX{Q) (34.1) 

dQ. 


-IT-00 


jnx[n]e~ iCin 


which yields the frequency-differentiation property of the DTFT as 


nx[n] 


F ,dX(Q) 
** 1 dQ. 


(3.2.12) 


This means that multiplication by n in the time domain results in differentiation 
w.r.t. £2 and multiplication by j in the frequency domain. 


3.2.9 Time and Frequency Scaling 

In the continuous-time case, we have Eq. (2.5.21) as 

x{at) 4 J- X (-) 

\a\ \aJ 

However, it is not so simple to define x[an ] because of the following reasons: 

- If a is not an integer, say, a — 0.5, then x[0.5 n] |„ =1 = x[0.5] is indeterminate. 

- If a is an integer, say, a = 2, then it does not merely speed up x[n], but takes the 
even-indexed samples of x[n]. 

Thus we define a time-scaled version of x[u] as 

r , I x[n/K] for n = Kr (a multiple of K ) with some integer r 
x<K)[n] = | (3.2.13) 

I 0 elsewhere 
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which is obtained by placing (K — 1) zeros between successive samples of x[n]. 
Then we apply the DTFT formula (3.1.1) to get 

x m c^) (3 = 1) Y.Z-oo X(K)[n]e ~ jan w 1*1;!r T l Z- O0 x[r]e ~ jnKr = X(KQ) 

(3.2.14) 


3.2.10 Parseval’s Relation (Rayleigh Theorem) 

If x[n] has finite energy and the DTFT X(Q.) = !F{x\n\), then we have 

( 3 . 2 . i5 ) 

where |X(£2)| 2 is called the energy-density spectrum of the signal x[n], 

3.3 Polar Representation and Graphical Plot of DTFT 

Similarly to the continuous-time case, we can write the polar representation of the 
DTFT as 


X(£2) = |X(£2)|ZX(£2) 

If x[ri\ is real, then its DTFT A(£2) = T{x[n]} has the following properties: 

- A(£2) is periodic with period 2jr in £2. 

- The magnitude |X(£2)| is an even function of £2 and is symmetric about £2 = mix 
(m: an integer). 

- The phase ZX(£2) is an odd function of £2 and is anti-symmetric about £2 = imr 
(m: an integer). 

Note that all the information about the DTFT of a real-valued sequence is contained 
in the frequency range [0, re] since the portion for other ranges can be determined 
from that for [0, n~\ using symmetry and periodicity. Consequently, we usually plot 
the spectrum for 0 < £2 < n only. 

Remark 3.3 Phase Jumps in the DTFT Phase Spectrum 

From the phase spectra shown in Fig. 3.1(cl)-(c2) and 3.7(cl)-(c2), it can be 
observed that there are two occasions for which the phase spectrum has discontinu¬ 
ities or jumps: 


- A jump of ±2 7t occurs to maintain the phase value within the principal range of 

[-7T, +Tt]. 

- A jump of ±7t occurs when the sign of X(£2) changes. 
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The sign of phase jump is chosen in such a way that the resulting phase spectrum 
is odd or antisymmetric and lies in the principal range [—n, +;r] after 
the jump. 

Remark 3.4 The DTFT Magnitude/Phase Spectra of Symmetric Sequences 

(1) Especially for anti-symmetric sequences, their magnitude spectrum is zero at 
£2 = 0 (see Fig. 3.7(bl)-(b2)). This implies that the DC gain of digital filters 
having an anti-symmetric impulse response is zero so that they cannot be used 
as a lowpass filter. 

(2) As for the sequences that are even/odd about some point, their DTFTs have 
linear phase —MQ. (proportional to the frequency) except for the phase jumps 
so that the DTFT phase spectra are piecewise linear. Also, symmetric/anti¬ 
symmetric sequences, that are just shifted versions of even/odd ones, preserve 
linear phase because shifting does not impair the linear phase characteristic 
(see Eq. (3.2.6)). This is illustrated by Examples 3.1, 3.11, and 3.12 and will be 
restated in Remark 4.8, Sect. 4.6. 


Example 3.11 DTFT of an Odd Sequence 
For an odd sequence 

Xl [n]= ■■■ 0 12 l 0 -1 -2 -1 0 0 ••• (E3.11.1) 



(bl) The CTFT/DTFT magnitude spectra of x, (f)/x, [n] (b2) The DTFT magnitude spectrum of x 2 [n] 



(cl) The DTFT phase spectrum of x^[n] (c2) The DTFT phase spectrum of x 2 [n] 


Fig. 3.7 The DTFT spectra of an odd sequence and an anti-symmetric sequem 
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we have its DTFT as 

Xi(a) = J2Z-oo Xl[n]e ~ inn 

= e m _ e -jM + 2 (e ^ - e-J™) + e ^ - e~* * ( = 2> ]2 sin(3£2) 

+ 7 4 sin(2£2) + j2 sin(tt) <D = 2) 4 sin(2£2) (1 + cos £2) e j7C/2 (E3.11.2) 


Noting that the continuous-time version of this sequence is apparently the sum of 
two opposite-sign shifted triangular pulses, we can compute its CTFT spectrum as 


xi(t) = 2(k D (t + 2 ) - \ D (t - 2 )) ^ 3 * 2 ^ 2 
X\(co) = 4 sine 2 ^ (e j2<0 — e~ j2w ) = 78 sin(2«) sine 2 ^ (E3.11.3) 

This sequence and its DTFT magnitude/phase spectra are depicted in Fig. 3.7(al) 
and (bl)/(cl), respectively. The CTFT magnitude spectrum (E3.11.3) (divided by 
sampling interval or period T) is plotted (in a dotted line) together with the DTFT 
magnitude spectrum in Fig. 3.7(bl) for comparison. 


Example 3.12 DTFT of an Anti-Symmetric Sequence 
For the sequence which is anti-symmetric about n = 1.5 

n - -2 -1 012345 

x 2 [n\ = ••• 0 0 -1 2 -2 1 00 ••• 


(E3.12.1) 


we have its DTFT a; 


Z 2 (£2) = ~_oo Xl[n] e ~ j =~ l + 2e ~ jn ~ 2e ~ jia + e ~ i3n 
= -(1 - e~ m ) + 2(e~ jn - e~ j2Q ) 

= _ e -mi2^ e m/2 _ e -73S2/2 ) + 2e -mi2( e jQ/2 _ e -7£2/ 2) 


D = _) 27 e ' 3n/2 ^2sin “ sin ( 3 f)) 

eij(2sin(|)-sin(3|)) Z (“ 3 f+ |) 0*3.12.2) 


This sequence and its magnitude/phase spectra are depicted in Fig. 3.7(a2) and (b2)/ 
(c2), respectively. 
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3.4 Discrete Fourier Transform (DFT) 

Before going into the DFT, let us consider the computational difference between 
the CTFS or CTFT for a periodic or an aperiodic continuous-time function x(t) and 
the DTFT for the discrete-time sequence x[n\ consisting of the samples of x(t). 
Since the CTFS (2.1.5b) and CTFT (2.2.1a) involving a continuous-time integral 
can be computed analytically for only x(t) described by some basic functions and 
require a numerical integration method for general finite-duration time functions, 
they are not practical when we need to find the spectra of real-world signals. The 
DTFT (3.1.1) is computationally advantageous over the CTFS or CTFT since it does 
not involve any continuous-time integration. However, it can be computed, say, by 
using the MATLAB routine “DTFT () ”, only for finite-duration sequences unless 
the sequence is expressed by some basic sequences such as an exponential or sine 
one. Therefore in practice, signals are truncated in various ways to obtain a set of 
finite number of samples [S-2]: 

- A transient signal is assumed to be zero after it decays to a negligible amplitude. 

- A periodic signal is sampled over an integral number of periods. 

- A random signal is multiplied by a “window” of finite duration (short-time 
Fourier transform). 

In any case, suppose we have a causal, finite-duration sequence x[n] containing M 
samples. Then the DTFT formula (3.1.1) becomes 

X(£2) = X[e^] = f{x[n]} = x[n]e~^ n (3.4.1) 

where N is set to be greater than or equal to M (the number of samples). Although 
it is easier to compute than the CTFS, CTFT, or the original DTFT, it may still 
annoy the computer because the frequency £2 takes continuous values for all that 
it is conventionally called the “digital” frequency. That is why we define and use 
another Fourier technique, called the /V-point DFT ( discrete Fourier transform), as 
follows: 

X(k) = DFT, v {x[«]} = x[n]e~ j2nkn/N = x M w n‘ (3.4.2) 

with W N = e~ il7t/N for k = 0 : N — 1 

This is an /V-point discrete-frequency sequence obtained by sampling one period of 
the finite version of DTFT, Eq. (3.4.1), conventionally at 

£2 = k£2 0 = k— for 0 < k < N — 1 
N 

where N is called the DFT size and £2o = 2 n/N the digital fundamental or res¬ 
olution frequency just like coq = 2n/P in the CTFS. Note that these N frequency 
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points are equally-spaced over the digital frequency range [0, 2 n) (excluding the 
upperbound 2it). Also we can write the IDFT ( inverse discrete Fourier transform ) 
formula as 

x[n] = IDFT,v{ A(fc)} = 1 Y^' Yk)e j2nkn/N 
N *—‘k =0 

1 N -1 . 

= — J2 k _ 0 X(k)W~ kn for n = 0 : N - 1 (3.4.3) 

Here, by substituting Eq. (3.4.2) into Eq. (3.4.3), we are going to demonstrate the 
validity of the IDFT formula, which amounts to verifying that the set of DFT sam¬ 
ples {X(k),k = 0 : N — 1} conveys all the information contained in the set of 
time-domain samples {x\n\,n = 0 : N — 1}, that is, x\ri\ can be recovered perfectly 
from X(k): 


*[»} j,, 5 Y °= 1 k Y Y '[»] w k t - 

=ei:>w(s z : <-') 

— ^2 0 x[m]8[(m — n) mod N ] °=' x[n\ 

(i a mod b or a modulo b : the remainder after division of a by b) 
where we have used the fact that 


_L V' N 1 W Hm-n) _ J_ 1 £ — j2nk{m—n)/N 

N £~, k=0 n N Z_^ =0 

1 if m — n = i N( i : an integer) 
0 otherwise 

There are two observations about the DFT pair (3.4.2) and (3.4.3): 


(3.4.4) 


- The DFT sequence X(k) is periodic in k with period N: 

X(k + mN ) (3 = 2) X[n] e ~j^d+mN)n/N 


m n (3A2) 


X(k) 


= Y? n -l x w e ~ j ™ n,Ne ~ j2m 


(3.4.5) 
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- The IDFT sequence x[n] is periodic in n with period N: 

,[„+,„«] 1 y^ 1 

= - V'" -1 °= S j-[n] (3.4.6) 

fV 

The first observation (3.4.5) is no wonder since the DFT X(k) inherits the periodicity 
of the DTFT X(Q.) as X(k) originates from the samples of X(Q.) over its period. In 
contrast, the second observation is very surprising since there is no reason to believe 
that any sequence x\ti\ is periodic and that with period equal to the DFT size N, 
which can be arbitrarily chosen as long as it covers the duration of x[n]. Because 
of this illusory periodicity, the shift involved with the time shifting property and the 
convolution related with the real convolution property of the DFT ton out to be 
not linear, but circular as will be discussed subsequently in Sects. 3.4.1 and 3.4.2. 
This headache is a kind of cost that we should pay in return for the computational 
convenience of DFT, which is discrete in both time and frequency so that it needs 
only multiplication and summation instead of integration. If only the sequence x[ri\ 
is really periodic with period N, the DFT is a perfect Fourier technique for analyzing 
the frequency characteristic and thus it might well be referred to as the discrete-time 
Fourier series (DTFS). In this context, when we want to emphasize the periodicity 
of DFT, we call it DFS (discrete Fourier series ) pair and write the DFS pair as 

X(k) = DFS, v {x [n]} = *[#] e~ j 2nkn ' N = El'c 1 :x[n] W n (3AJ) 

x [n] = IDFS „{!(*)} = 1 Ell *< J Qe j2 * kn/N = ~ Ell *<*) W ^" 

(3.4.8) 


3.4.1 Properties of the DFT 

The DFT has properties similar to those of the CTFS such as the real convolution 
property (2.5.13) since the DFT regards a time-domain sample sequence x[n\ as one 
period of its periodic extension (with period equal to the DFT size N) that can be 
described by 

x [n] = x N [n] r N [n] (3.4.9) 


where x,v[«] is the periodic extension of x[n] with period N and r, v [«] the rectan¬ 
gular pulse sequence with duration of n = 0 : fV — 1: 


x [n] = ^ x[n +mN] = x[n mod N] 


r N [n] = u s [n ] - u s [n — N] = 


0 


for 0 < n < 
elsewhere 


N — 1 


(3.4.10a) 

(3.4.10b) 
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On the other hand, the DFT sequence is born from the samples of the DTFT and 
thus it inherits most of the DTFT properties except that the real translation and 
convolution in the time domain are not linear, but circular as with the CTFS. There¬ 
fore we discuss only the two properties and summarize all the DFT properties in 
Appendix B. 

3.4.1.1 Real/Complex Translation - Circular Shift in Time/Frequency 

Figure 3.8(a), (bl), (b2), and (d) show a sequence x[n] of finite duration N = 4, its 
periodic extension xjy[n], its shifted version xj v [n—M] (M = 2), and its rectangular- 
windowed version x^[n — M]r N [n], respectively. You can see more clearly from 
Fig. 3.8(a), (cl), (c2), and (d) that x,\r[n — M]r N [n] is the circular-shifted (rotated) 
version of x[n] where Fig. 3.8(cl) and (c2) show the circular representation of the 
finite-duration sequence x[n] and its shifted or rotated version displayed around the 
circle with a circumference of N points. With this visual concept of circular shift, 
we can write the (circular) time-shifting property of DFS and DFT as 

x N [n — M] (circular shift) W^ k X(k) (3.4.11a) 

x N [n — M]r N [n] (one period of circular shift) W^ k X(k) (3.4.1 lb) 

We can also apply the duality between the time and frequency domains to write 
the (circular) frequency-shifting property of DFS/DFT: 

W^ Ln x N [n] r 2> X(k — L) (circular shift) (3.4.12a) 

W~ Ln x[n] X(k - L)r N [k ] (one period of circular shift) (3.4.12b) 



(b2) (d) 

Fig. 3.8 Circular shift of a sequence by 2 samples 
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3.4.1.2 Real/Complex Convolution - Circular Convolution 
in Time/Frequency 

Let us consider two sequences x[n] and y[n], both of duration M < N and each 
with DFT X(k) and Y(k), respectively. Also let us denote the periodic extensions of 
the two sequences and their DFSs by x[n], y[n], X(k), and Y(k ), respectively. Then 
we can write the product of the two DFSs X(k) and Y(k) as 

X(k) = DFS.vJx [n]} = x[m ] W k N m 

Y(k ) = DFS, v {>- [n]\ = J2 N r ~Q y M K 
■ X(k)Y(k) = Elo M }’ [r] <" ,+ ° (3.4.13) 


and compute its IDFS (inverse discrete Fourier series) as 
IDFS,v {X(k)Y(k)} ( = 8) 1 m)Y(k) W~ kn 

°=' (l ed; 

(3.4.4) x——1 \ yN —1 

= E m=0 * [m] E r=0 f [r]5[r - (n - m)] 

(1 = 32) El”!, x[m] y [n ~ m] = x[n] * y [n] (3 - 4 - 14) 


where * denotes the circular or periodic convolution sum with period N. This 
implies the real convolution property of DFS/DFT as 


Jc[n] * y [«] (circularconvolution) X(k)Y(k) (3.4.15a) 

DFT 

(x[n] * y [ri\)r N [n] (one period of circular convolution) -o- X(k)Y(k) (3.4.15b) 

In duality with this, we can interchange the time and frequency indices to write the 
complex convolution property as 

x[n] y [«] r £ S — Y X(i)Y(k — i ) = — X(k) * Y(k) (circular convolution) 

N L — 'i=0 N N 

(3.4.16a) 

DFT 1 / ~ \ 

x[n]y[n] «-»• — I X(k)*Y(k)\ r N [k] (one period of circular convolution) 

N \ n I 


(3.4.16b) 
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Note that the shift of a periodic sequence along the time/frequency axis actually 
causes a rotation, making the sequence values appear to wrap around from the 
beginning of the sequence to the end. 


3.4.2 Linear Convolution with DFT 


As discussed in the previous section, circular translation/convolution is natural with 
the DFT/DFS. However, in most applications of digital signal processing, linear 
convolution is necessary. As will be seen later, very efficient algorithms called FFT 
are available for computing the DFT of a finite-duration sequence. For this reason, 
it can be computationally advantageous to use the FFT algorithm for computing a 
convolution in such a way that the linear convolution corresponds to a single period 
of a circular convolution. 

Specifically, suppose the signals x[n\ and y[n] are of finite duration N x and N y , 
and defined on n = 0 : N x — 1 and on n = 0 : N y — 1, respectively. Then, the 
procedure for computing the linear convolution z[ri\ = x[n] * y[ri\ is as below (see 
Fig. 3.9): 


0) Extend the given sequences x[n] and y[n] to the duration of N > /V, + N y — 1 
by zero-padding where N x + N y — 1 is the expected length of the linear 
convolution of the two sequences (see Remark 1.5(1)). 

(cf.) Zero-padding a sequence means appending zeros to the end of the 
sequence.) 

1) Compute X(k) = DFT iV {x[u]) and Y(k) = DFT,v {>'[«]). (3.4.17a) 

2) Multiply the two DFT sequences Z(k ) = X(k)Y(k) 

for k = 0 : N — l. (3.4.17b) 

3) Compute z[n] = TDFT, v {Z(fc)} where z[n] = x[n\ * y[n], (3.4.17c) 

Example 3.13 Linear Convolution Using the DFT 

We want to find the linear convolution z.[n] = x[n] * y[n] of the two sequences 
depicted in Fig. 3.10(a), where 


I I for n = 0 
0.5 for n — 1 
0 elsewhere 


and 


y[n] = 


for n = 0 
for n = 1 
elsewhere 


(E3.13.1) 



Fig. 3.9 Linear convolution using the DFT 
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(a) Time-domain approach (Fig. 3.10(a)) 

z[n] = 0 for n < 0 or n > 3(= N x + N y - 1 = 2 + 2 - 1) 
z[0] = x [0] y[0] + x[l] y[—1] = 0.5 

z[ 1] = X [0] y[ 1] + x[l] y[0] = 1.25 (E3.13.2) 

s[2] = x [0] y|2] + x| I ] v[ I] = 0.5 
c[3 ] = x 10] y [ 3 ] + x| l)y[2] = 0 

(b) Frequency-domain approach with 2-point DFT (Fig. 3.10(b)) 

We can use the DFT formula (3.4.2) with N = 2 to get the DFTs of the two 
sequences as 

X 2 (k) = Y, 2 n=o x [n\e- j2lTkn/2 = 1 + 0.5(—1)* = 1.5, 0.5 for k = 0, 1 

Y 2 (k) = Z 2 „Zo yMe j2ltkn/2 = 0.5 + (-1/ = 1.5, -0.5 for k = 0, 1 
so that 

Z 2 (k) = X 2 (k) Y 2 (k) = 2.25, -0.25 for k = 0,1 (E3.13.3) 

Then we use the IDFT formula (3.4.3) to get 

zi[n] = ^ XiLo z 2(k)e j2ltkn/2 

= ^ (z 2 (0) + C-1)"Z 2 (1)) = 1, 1.25 for n= 0,1 (E3.13.4) 


m Un] «,[«] 



(a) Linear convolution (b) Circular convolution with 2-point DFT (c) Circular convolution with 3-point DFT 

Fig. 3.10 Linear and circular convolutions with DFT 
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This corresponds to one period of the periodic extension of z[«] (obtained in part 
(a)) with period N = 2 and is not equal to z[n]. This illustrates that time-aliasing 
effect might occur if the DFT size N is not sufficiently large. 

(c) Frequency-domain approach with 3-point DFT (Fig. 3.10(c)) 

We can use the DFT formula (3.4.2) with N = 3 to get the DFTs of the two 
sequences as 

X 3 (k) = J2 3 ~= 0 x[n]e- j27 ' kn/3 = 1 + 0.5e~ j27tk/3 

= 1.5, 1 + 0.5e~ j27t/3 , 1 + 0.5e~ j47l/3 for k = 0, 1,2 

Y 3 (k) = y[n]e~ j27rkn/3 = 0.5 + e~ i2ltkl3 

= 1.5, 0.5 + e~ j2nl3 , 0.5 + e~ j47C/3 for k = 0, 1, 2 


so that 

Z 3 (Jk) = X 3 {k)Y 3 (k ) = 0.5 + l.25e~ i27lk/3 + 0.5e~ j47lk/3 (E3.13.5) 

We can match this with the IDFT formula (3.4.3) to get 

z 3 [n] = 0.5, 1.25, 0.5 forn = 0, 1, 2 (E3.13.6) 

This agrees with the linear convolution z[ri\ obtained in part (a) for n — 0 ~ 2. 
(d) MATLAB Program 

We can run the following program “sig03el3.m” to apply the above procedure 

to get the linear convolution using the DFT. Note the following: 

- The built-in MATLAB functions “f ft (x, N) ” and “if ft (X, N) ” are used 
to compute the N-point DFT X(k ) = DFT iV {x[«]) and IDFT x[n] = 
IDFT w {X(fc)}, respectively. 

- Depending on whether the length of the sequence given as the first input 
argument of “f ft (x, N) ” or “if ft (X, N) ” is less or greater than the sec¬ 
ond input argument N, the sequence will be zero-padded or truncated so that 
its resulting length will be N. 

- Note that, to exploit the computational efficiency of FFT (fast Fourier trans¬ 
form), the DFT size N should be chosen as a power of two greater than or 
equal to the length of the sequence. 
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(cf.) The above procedure, which is depicted in Fig. 3.9 and illustrated in 
Example 3.13, paves the way to use the DFT for computing the linear 
convolution of two finite-duration sequences. 


Remark 3.5 How to Choose the DFT Size N in Connection with Zero Padding 

(1) In computing the DFT of a given sequence x[n] of length M, we are free to 
choose the DFT size N, i.e., the number of sampled frequency points over 
[0, 2jt) (one period of digital frequency) as long as it is greater than or equal to 
M. Choosing N > M corresponds to increasing the length of x [n] by appending 
it with additional zero-valued samples - padding with zeros. This procedure 
called zero padding may be used to fill out the sequence length so that an 
N — 2 L -point FFT (fast Fourier transform) algorithm could be applied (see 
Sect. 3.6) or a linear convolution of two sequences could be performed with¬ 
out causing a time-aliasing problem (see Example 3.13). It can also be used to 
provide a better-looking display of the frequency contents of a finite-duration 
sequence by decreasing the digital frequency spacing (resolution frequency) 
2n/N so that the discrete DFT spectrum X(k) can look close to the continuous 
DTFT spectrum X(£2) (see Example 3.14). 

(2) As can be seen from the DTFT formula (3.1.1), zero padding does not alter the 
continuous spectrum X(Q.), but just decreases the interval width between suc¬ 
cessive discrete frequencies in the DFT spectrum. However, when the signal is 
not of finite duration, zero padding can lead to erroneous results. Conclusively, 
zero padding is justified only when a signal is of finite duration and has already 
been sampled over the entire range where it is nonzero. 


3.4.3 DFT for Noncausal or Infinite-Duration Sequence 

Fet us consider the DFT formula (3.4.2): 

X(k) = DFTjv{x[n]} = x[n]e~ j27tkn/N fork = 0 : A - 1 

This is defined for a causal, finite-duration sequence x[n] so that we can cast 
it into a computer program without taking much heed of the negative indices. 
(C language prohibits using the negative indices for array and MATFAB does not 
accept even zero index.) Then, how can we get the DFT spectrum of noncausal or 
infinite-duration sequences? The answer is as follows: 
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- For a noncausal sequence, append the noncausal part to the end of the sequence 
after any necessary zero-padding is done so that the resulting sequence can be 
causal. 

- For an infinite-duration sequence, set the time-duration [0, N — 1] so that the 
most significant part of the sequence can be covered. To increase the DFT size is 
also helpful in making the DFT close to the DTFT. Compare Fig. 3.11 (b2)/(c2) 
with (b3)/(c3). Also compare Fig. 3.12.l(bl) with Fig. 3.12.2(bl). 

Example 3.14 DFT of a Non-causal Pulse Sequence 

Consider a sequence which is depicted in Fig. 3.11 (a 1). Shifting the noncausal 
partx[—1] = 1/3 into the end of the sequence yields a causal sequence 

1 1/3 forn = 0, 1, N - 1 

(E3.14.1) 

0 elsewhere 

where N is the DFT size. This corresponds to one period of the periodic extension 
x N [n\ (see Fig. 3.11(a2) with N = 4 and (a3) with N = 8). 

Then we can compute the /V-point DFT of x N [n] as 



(al) A noncausal sequence (a2) Periodic extension with N= 4 (a3) Periodic extension with N= 8 



(bl) The DTFT magnitude spectrum (b2) The DFT magnitude spectrum (b3) The DFT magnitude spectrum 



DTFT phase ZX(£1) 4-point DFT phase ZX 4 (/r) 8-point DFT phase ZX 8 (/c) 

(cl) The DTFT phase spectrum (c2) The DFT phase spectrum (c3) The DFT phase spectrum 


Fig. 3.11 DTFT and DFT for a noncausal sequence 
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Figure 3.11 (b2)/(c2) and (b3)/(c3) show the magnitude/phase of this DFT with 

N = 4 and those with N = 8, respectively. Note the following: 

- The overlapped DTFT spectra in dotted lines, obtained in Example 3.1 and plot¬ 
ted in Figs. 3.1 and 3.1 l(bl)/(cl), illustrate the fact that the DFT X N (k) are just 
the samples of the DTFT X(Q) at £2 = k£2 0 = 2nk/N for 0 < k < N — 1 as 
long as the whole duration of the sequence is covered by [0 : N — 1]. 

- Figure 3.11(a2) and (a3) differ in the length of zero padding performed before 
appending the noncausal part to the end of the sequence. Comparing the corre¬ 
sponding DFT spectra in Figure 3.11 (b2)/(c2) and (b3)/(c3), we see that longer 
zero-padding increases the DFT size and thus decreases the digital resolution 
frequency £2 0 = 2jt/N so that the DFT looks closer to the DTFT. 

Example 3.15 DFT of an Infinite-Duration Sequence 

Consider a real exponential sequence of infinite duration described by 

x[n] = a n u s \n](\a\ < 1) (E3.15.1) 

This sequence is shown partially for n = 0 : 7 in Fig. 3.12.1(al) and for n — 0 : 15 

in Fig. 3.12.2(al). 

(a) The DTFT of this infinite-duration sequence was obtained in Example 3.2 as 

X(£2) (E = a) --—— (E3.15.2) 

1 — ae~ Jil 

Thus we get the samples of the DTFT at £2 = kQ () = 2nk/N as 



(al) A part of an infinite-duration sequence (bl) The 8-point DFT X e (k) and the DTFT X(Cl) 



(a2) Periodic extension of x[n] with period N= 8 (b2) Samples of the DTFT X(Q) at £2 = 2nklN 

Fig. 3.12.1 Relationship between the 8-point DFT and the DTFT for an infinite-duration 
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T x[0:15] 

) ■ ►_#- illlTTTTftTTTf _ w 

0 4 8 15 

(al) A part of an infinite-duration sequence 



Fig. 3.12.2 Relationship between the 16-point DFT and the DTFT for an infinite-duration 
sequence 


k 


Him 


'-i-rrll I 


(bl) The 16-point DFT X 16 (k) and the DTFT X(£2) 


X(kQ. 0 ) 


(E3T5.2) 1 _ 1 

1 _ ae -jk£l 0 1 — ae -jl7tk/N 

=--— r with W N = e ~ j2n/N 

1 -aWl 


(E3.15.3) 


(b) We can use the DFT formula (3.4.2) to find the /V-point DFT of x[n] for n = 
0 : N - 1: 


Y*" 1 a n W nk = l ~ a Wn - . 
^„=o N 1 -aW k N 1 


r for k = 0 : N - 1 
(E3.15.4) 


Comparing this with (E3.15.3) reveals the following: 

- The DFT and the DTFT samples are not exactly the same for an infinite- 
duration sequence, while they conform with each other for a finite-duration 
sequence whose duration can somehow be covered in [0 : N — 1] 

- Larger DFT size N will make the DFT closer to the sampled DTFT. This can 
also be seen visually by comparing Figs. 3.12.l(bl) and 3.12.2(bl). 

(c) One might wonder what the time-domain relationship between the DFT X(k ) 
and the sampled DTFT X(k£2o) is for the infinite-duration sequence. This 
curiosity seduces us to find the IDFT of X(kQo) as 
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x N [n] = IDFT{X(kfi 0 )} (3 = 3> — * X(kki 0 )W~ kn 

N ‘—‘k =0 


(E345.3) 1 y*-l kn 1 (023) J_ yN-l , oo , 

N N l -aW k N 1^=0 M 

=e> (s e;:: <'->) o = i, e«“’ + " 


- for n = 0 : IV — 1 


This corresponds to one period of the periodic extension x N [n\ of x[n] with period 
N and it becomes closer to x\n\ as the DFT size N increases. Note the following: 


Just as the sampling of continuous signal x(t) in the time domain results in the 
periodic extension of X(co) = !F{x(t)} in the frequency domain (Eq. (E2.13.3)), 
so the sampling of continuous spectrum X(co) or X(£2) in the frequency domain 
results in the periodic extension x P (t ) (of x(t) = F~ l 2 {X(co)}) or x,v[«] (of 
x[n] = {X(Q.)}) in the time domain. 

Besides, just as shorter time-domain sampling interval ( T) in the sampling of 
x(t ) to make x[n] = x(nT) increases the frequency band on which the CTFT 
X(o>) = J r {x(f)} is close to the DTFT X(Q.) = F{x[n]}, so narrower frequency- 
domain sampling interval («o/^o) in the sampling of X{w)/X(Q.) to make 
X(ka>o)/X(k£2o) expands the time range on which xp(t) (with P = 2n/coo) or 

x, v[«] (with N = 2ti/Qq) is close to x(t) or x[n]. 

However short the time-domain sampling interval in the sampling of x(t) to make 
x [n] may be, X(Q.) = ^ ? {x[u]} for —n < S2 < n cannot be exactly the same as 
X(co) = lF{x(t)) for —n/T < co < n/T due to the frequency-aliasing unless 
X(co) is strictly bandlimited. Likewise, however narrow the frequency-domain 
sampling interval in the sampling of X(co)/X(Q.) to make X(kojo)/X(kQo) may 

be, the corresponding periodic extension x P (t)/x N [n] cannot be exactly the 
same as x(t)jx\n\ for one period of length P/N due to the time-aliasing unless 
x(t)/x\n] is strictly time-limited. 


Remark 3.6 The DFT for Noncausal/Infinite-Duration Sequences 

The DFT pair (3.4.2) and (3.4.3) can be used to analyze the frequency character¬ 
istic of causal, finite-duration sequences. Then, how do we deal with noncausal or 
infinite-duration sequences? 

(1) For a noncausal sequence, append the noncausal part to the end of the sequence 
after any necessary zero-padding is done so that the resulting sequence can be 
causal. 

(2) For an infinite-duration sequence, set the time-duration [0, N — 1] so that the 
most significant part of the sequence can be covered. If the duration is shifted, 
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apply the time-shifting property to the DFT for obtaining the right phase spec¬ 
trum. You can also increase the DFT size to make the DFT close to the DTFT, 
which accommodates infinite-duration sequences. 


3.5 Relationship Among CTFS, CTFT, DTFT, and DFT 
3.5.1 Relationship Between CTFS and DFT/DFS 


To investigate the relationship between CTFS and DFT/DFS, suppose we have a 
continuous-time periodic signal Xp(t ) with period P and its discrete-time version 
x w [n] = xp(nT), which is obtained by sampling xp(t) at the rate of N times per 
period P. Since xp(t) is a continuous-time periodic signal with period P, we can 
use Eq. (2.1.5a) to write its CTFS representation as 


(2.1.5a) 1 


ol P=NT 1 y ^°° 

o>o=2n/P=2n/NT NT ^k= 


Substituting t — nT into this equation and using the fact that e' 2jrknl 
only for n mod N yields 

x r (nT)°=’ X = X X t e» 


is unique only for n mod N) 


NT ^k=0 ^m= 


-- — y ]^” 1 (- v °° 

N ^k=0 V T 


We can match this equation with the IDFS/IDFT formula (3.4.8)/(3.4.3) for x N [n] — 
x P (nT) 

x N [n}=±Y^^X N (k) eJ2 * k * ,N 

to write the relation between the CTFS coefficients X k of a periodic signal xp(t) 
(with period P = NT) and the /V-point DFT/DFS coefficients X N (k) of x N [n] = 
x P (nT) as 

X„(.k) = - YZ=-»o Xk+mN (3 - 5 ’ 3) 

This implies that the DFT/DFS of %[«] = Xp(nT) is qualitatively the periodic 
extension of the CTFS of xp(t ) (with period N in frequency index k), i.e., the 
sum of infinitely many shifted version of CTFS. This explains how the DFT/DFS 



3.5 Relationship Among CTFS, CTFT, DTFT, and DFT 


strays from the CTFS because of frequency-aliasing unless the CTFS spectrum 
Xk is strictly limited within the low-frequency band of (— (N/2)coo, (/V/2)<wo) = 
(—jt/T, Jt/T) where the DFT size N equals the number of samples per period P 
and the fundamental frequency is wq = for/P = 2n/NT. 

3.5.2 Relationship Between CTFT and DTFT 

To investigate the relationship between CTFT and DTFT, suppose we have a 
continuous-time signal x(t ) and its discrete-time version x[n] — x(nT). As a bridge 
between x(t) and x\n\, let us consider the sampled version of x(t) with sampling 
interval or period T as 

x*(t) = x(t)8 T (t) (S T (t) = <5(t — nT) : the impulse train) (3.5.4) 

Noting that x jj) is still a continuous-time signal, we can use Eq. (2.2.1a) to write 
its CTFT as 

XAcof^j x.Jj)e^ 1< " t dt G = 4) J x{t) Y_ S(t — nT)e~ i<ot dt 

— T, J x{t)e~ jcot S(t — nT) dt (1 '= 25) x(nT)e~ jmnT 

= El. x W e~ jan \ n=wT (3 = X> ^(£2)W (3.5.5) 

This implies that X d (Q.) = DTFT{x[n]} and X.Jm) = CTFT{x*(t)} are essentially 
the same and that 2Q(£2) can be obtained from X Joj) via a variable substitution w = 
S2/T. On the other hand, we recall from Eq. (E2.13.3) that X Jo)) = CTFT{x*0)} 
is expressed in terms of X(co) — CTFT{x(t)} as 

X*(&>) <E2 =' 3) ^ ^ X(oj + mco s ) with co s = ^ (3.5.6) 

Combining these two equations (3.5.5) and (3.5.6), we can write the relation 
between the CTFT and the DTFT as 

W 3 A J> i x d + (3.5.7) 

where co and Q are called the analog and digital frequency, respectively. 

This implies that the DTFT of x[n] = x(nT) is qualitatively the periodic 
extension of the CTFT of x(t) (with period 2n/T in analog frequency w or 2n 
in digital frequency £2), i.e., the sum of infinitely many shifted version of CTFT. 
This explains how the DTFT strays from the CTFT because of frequency-aliasing 
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unless the CTFT spectrum X(oj) is strictly limited within the low-frequency band 
of {—n/T, n/T) where T is the sampling interval of x\ri\ = x(nT). Fig. 3.7(bl) 
illustrates the deviation of the DTFT spectrum from the CTFT spectrum caused by 
frequency-aliasing. 


3.5.3 Relationship Among CTFS, CTFT, DTFT, and DFT/DFS 

As stated in Remark 2.7(2) and illustrated in Fig. 2.8, the CTFS X k ’s of a periodic 
function x P (t ) are the samples of the CTFT X(co) of the one-period function xp(t) 
dXkcoQ = 2n k/P: 


V= 4) X(cu) U k0)M/P (3.5.8) 

Likewise, as discussed in Sect. 3.4 and illustrated in Fig. 3.11, the DFT/DFS X(k )’s 
of a periodic sequence x P [n ] are the samples of the DTFT X d (Q) of the one-period 
sequence x P \ti\ at k€lo = 2nk/N: 

X(k ) (3A1 ! (3A2) X d m^ k n 0 =2n k /N (3.5.9) 

Figure 3.13 shows the overall relationship among the CTFS, CTFT, DTFT, and 
DFT/DFS based on Eqs. (3.5.3), (3.5.7), (3.5.8), and (3.5.9). Figure 3.14 shows 
the CTFT, DTFT, DFT/DFS, and CTFS spectra for a continuous-time/discrete- 
time rectangular pulse or wave, presenting us with a more specific view of their 
relationship. Some observations are summarized in the following remark: 

Remark 3.7 Relationship among the CTFS, CTFT, DTFT, and DTFS (DFT/DFS) 
Figures 3.13 and 3.14 shows the overall relationship among the CTFS, CTFT, 
DTFT, and DTFS (DFT/DFS) from a bird’s-eye point of view. The following 
observations and comparisons are made. 

(1) Among the four Fourier spectra, the CTFS and CTFT are more desired than 
the DTFS and DTFT since all physical signals are continuous-time signals. 



Fig. 3.13 Overall relationship among the CTFT, CTFS, DTFT, and DTFS (DFT/DFS) 
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(a3) - a periodic extension of x{t) with period p=8 (b3) The CTFS spectrum X k of X 8 (f) 



(a5) 3r 16 (n) - a periodic extension of x[ri[ with period W=16 (b5) W = 16- point DFS/DFT spectrum X(K) of x 16 [n] 

Fig. 3.14 Examples of CTFT, DTFT, DFS/DFT, and CTFS spectra 

Between the CTFS and CTFT, we prefer to have the CTFT because it has all the 
information contained in the CTFS on the assumption that the CTFS consists of 
the samples of CTFT (Eq. (3.5.8) and Fig. 3.14(b3)). Besides, the CTFS is not 
so practical because it is hard to find the period or even periodicity of periodic 
signals due to a noise. Therefore, we think of the CTFT as a standard when 
we need to compare the spectra in terms of how faithfully they describe the 
frequency contents of a given signal. 

(2) The problem with the CTFS and CTFT is that they are difficult to compute 
due to the integration. Compared with them, the DTFT X,j(Q) is easier to deal 
with since it has only multiplications and additions. However, the sampling 
of x(t) (with sampling interval T) to make x[n] = x(nT ) produces the peri¬ 
odic extension of the CTFT spectrum X(co) with period 2tz/T in w, causing 
frequency-aliasing in the case of non-zero frequency components outside the 
principal analog frequency band \—n/T, n/T]. This is the cost we pay in 
return for the computational convenience of the DTFT. This frequency-aliasing 
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can be reduced by decreasing the sampling interval T so that more frequency 
components can be contained in [—n/T, n/T]. (Compare the DTFT spectra in 
Fig. 3.14(bl) (for T = 1) and (b4) (for T = 0.5) with the CTFT plotted in 
dotted lines.) Refer to the sampling theorem to be discussed in Sect. 5.3, which 
presents a criterion for selecting the sampling interval. 

(cf.) To compare the DTFT X d (Q) with the CTFT X(w), we should divide X{co) 
by the sampling interval T (refer to Eq. (3.5.7)). 

(3) The DTFT X d (Q.) of x[n] is computationally advantageous over the CTFS 
or CTFT, but is still not so handy since it is continuous in the frequency 
Q and thus requires an integration for IDTFT (inverse DTFT). That is why 
we sample the DTFT in the frequency domain at kQo = 2 nk/N for k — 
0 : N — 1 to make an /V-point DFT X(k) for more computational efficiency. 
However, it also costs us the (illusory) periodic extension of x\n\ with period 
N (the DFT size) irrespective of whether x[n] is originally periodic or not 
and no matter what the real period is even if x[n\ is really periodic. This 
causes time-aliasing if the original signal is not sufficiently covered within 
the whole time interval [0, TV — 1] (Example 3.15) and spectral leakage prob¬ 
lem when the DFT size does not conform to the real period of the signal 
(Example 3.16). 

(4) The analog resolution frequency coq = £2 0 /T = 2n/NT — 2n/P can be 
improved by increasing the whole time interval P = NT. Increasing the DFT 
size N (, say, by zero-padding) helps the DFT spectrum to become close to 
the DTFT spectrum. Decreasing the sampling interval T increases the period 
2 n/T of periodic extension of the CTFT spectrum (Eq. (3.5.7)) or equivalently, 
expands the principal analog frequency band [—n/T, n/T] so that the chance 
and degree of frequency aliasing can be reduced. 

(5) Generally, we can choose the DFT size N and sampling interval T and thus, 
eventually P = NT (the product of N and T) during which a signal is to be 
measured, sampled, and collected as a set of N data points. Therefore, it is hard 
to imagine that NT happens to be identical with the real period of the signal. 
For this reason, it will be reasonable to call P = NT the whole time interval 
rather than the period that was originated from the definition of the CTFS. 


3.6 Fast Fourier Transform (FFT) 

In this section we discuss the FFT algorithm that exploits the periodicity and sym¬ 
metry of the discrete-time complex exponentials e ,2llnk ^ N to reduce significantly the 
number of multiplications for the DFT computation. The FFT algorithm discussed 
here achieves its efficiency when N is a power of 2, i.e., N = 2 NL0G1 for some 
integer NLOG2. This makes no practical problem since the length of x[n] can be 
increased to the next power of 2 by zero-padding. 

To get some understanding of the steps in the FFT algorithm, let us consider a 
sequence x[n] for {)< n < N — } with N = 2 NLOG1 . There are two approaches. 
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each of which is based on the decimation process in the time and frequency domain, 
respectively. 


3.6.1 Decimation-in-Time (DIT) FFT 

In this approach, we break the IV-point DFT into two N /2-point DFTs, one for 
even-indexed subsequence x[2r ] and the other for odd-indexed subsequence x[2r + 
1], then break each N /2-point DFT into two N /4-point DFTs and continue this 
process until 2-point DFTs appear. Specifically, we can write the /V-point DFT of 
x[n] as 

= E"S' +Z"T xl2r + 

(Wu k = e -j^W _ e -j 27 rrk/(N/ 2 ) = 

= E r=0 ^M</2 + <E,. =0 x °^ w m 

(3 = 2) X e (k) + W k N X a {k ) for 0 < k < N — 1 (3.6.1) 


so that 


X(kf^ V> X e (F)+ W&X„(k) for 0 < k < N/2 — 1 (3.6.2a) 

X(k) (3 = !> X e (k) + W k N X 0 {k) for N/2 <k < N — l\ 

X(k + N/2) (3 = !) X e (k + N/2)+ W k N +N/2 X a (k + N/2 ) 

= X e (k) - W k N X 0 {k) for 0 < k < N/2 - 1 (3.6.2b) 

where X e (k) and X a (k) are N/2 -point DFTs that are periodic with period N /2 in 
k. If N/2 is even, then we can again break X e (k) and X 0 (k) into two N/4 -point 
DFTs in the same way: 


*«(*) ■ lW\rn X ^ k) + </2*eo(k) 

with N^-N/2 ' 

= X ee (k) + Wfx eo (k) for 0 <k< N/2 - 1 (3.6.3a) 

X ° (k Kil 3 ^N/2 X ° e(k) + W N/2 X oo(k) 

= X oe {k) + wl k X 00 (k) for 0 < k < N/2 - 1 


(3.6.3b) 
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If N = 2 NLOG1 , we repeat this procedure NLOG2 — 1 times to obtain N/2 2 -point 
DFTs, say, for N = 2 3 , as 


Xe,(k) = 1 x ee [n]W k N n /4 = x[0] + (—l/r[4] (3.6.4a) 

with x ee [n\ = x e \2n\ = x[2 2 n] 

Xeo(k) = Y.ZV 4 = x[2] + (—l)*x[6] (3.6.4b) 

with x eo [n] = x e [2n + 1] = x[2 2 n + 2] 

X oe {k) = YZZIZ X oeM W N/4 = *[U + f-l)**|5] (3.6.4c) 

with x oe [n] = x a \2n] = x[2 2 n + 1] 

X 00 (k) = J2ZV Xoo[n] = *P] + (- !)**[?] (3.6.4d) 

with x oa [n] = x„[2n + 1] = x[2 2 n + 2+1] 

Along with this procedure, we can draw the signal flow graph for an 8-point DFT 
computation as shown in Fig. 3.15(a). By counting the number of branches with 
a gain W r N (representing multiplications) and empty circles (denoting additions), 
we see that each stage needs N complex multiplications and N complex additions. 
Since there are log 2 N stages, we have a total of N log 2 N complex multiplications 
and additions. This is a substantial reduction of computation compared with the 
direct DFT computation, which requires N 2 complex multiplication and N(N — 1) 
complex additions since we must get N values of X(k) for k = 0 : N — 1, each X(k) 
requiring N complex multiplications and N — 1 complex additions. 

Remark 3.8 Data Rearrangement in “Bit Reversed” Order 

The signal flow graph in Fig. 3.15 shows that the input data x[n\ appear in the 
bit reversed order: 

Position Binary equivalent Bit reversed Sequence index 

3 -+ Oil -* 110 -* 6 

4 +*: 100 -* 001 r-# 1 

Remark 3.9 Simplified Butterfly Computation 

(1) The basic computational block in the flow graph (Fig. 3.15(b)), called a butter 
fly, for stage m + 1 represents the following operations such as Eq. (3.6.2): 

X m+ i(p) = X m (p) + W r N X m {q), with q = p + 2 m (3.6.5a) 

X m+ i(q) = XJp) + W r N +N/2 X m (q) = X m (p) - W r N X m (q) (3.6.5b) 

(Y W r N +N/2 = -W r N ) 
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XM 



X m (P) o-X m+1 (p) 

XJq) o-X m+1 ((j) 


(b) Simplifying the butterfly computation 



where p and q are the position indices in stage m + 1. Notice that X m+ \(p) 
and X m+ i(q), the outputs of the butterfly at stage m + 1 are calculated in terms 
of X m (p) and X m (q), the corresponding values from the previous stage and 
no other inputs. Therefore, if a scratch memory for storing some intermediate 
results is available, X m+ i(p) and X m+ \(q) can be calculated and be placed back 
into the storage registers for X m (p) and X m (q). Thus only N registers for storing 
one complex array are needed to implement the complete computation. This 
kind of memory-efficient procedure is referred to as an in-place computation. 
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(2) Noting that the horizontal multiplier is just the negative of the diagonal mul¬ 
tiplier, the basic butterfly configuration can be further simplified. Specifically, 
with T — W r N X m (q), we have the simplified butterfly computation 

X m+l (p) = X m (p)+T 
X m+ i(g) = X m {p) - T 

which is depicted in Fig.3.15(b). This reduces the number of complex multi¬ 
plications for the DFT computation to half of that with the original butterfly 
computation (3.6.5a) (Fig. 3.15(c)): 

N 

N log 2 N -* — log 2 N 

3.6.2 Decimation-in-Frequency (DIF) FFT 

An alternative algorithm for computing the DFT results from breaking up or 
decimating the transform sequence X(k). It begins by breaking up X(k) as follows: 

X (k) = E„ =0 W n = E„ = o x[n] <■ + E B=JV/2 K 

x—>N/2—1 * in n x——1 < 

= J2 n=0 X [»] W N + W N ~ E„=o X[n + N/2] Wn 

= EZo” 1 (x[n] + ( ~ ])kx[n + N / 2])W n 0.6.6) 

We separate this into two groups, i.e., one group of the even-indexed elements (with 
k = 2r) and the other group of the odd-indexed elements (k = 2r + 1) of X(k)\ 

X{2 r) = J^o” 1 (x[n] + + N/2])W^ rn (3.6.7a) 

= E^-o” 1 (x[n] +x[n + N / 2 V W n /2 for 0 < r < N/2 - 1 

X(2r + 1) = (*[»] ~ x[n + N/2])W% r+1)n (3.6.7b) 

v JV/2—1 

= E„ =0 ( X M -x[n + N/2])W"W r N n /2 for 0 < r < N/2 - 1 

These are N/2 -point DFTs of the sequences {x[ri\ +x[n + N/ 2]) and {x[ri]—x[n + 
N/2])W", respectively. If N = 2 NLOG1 , we can proceed in the same way until it 
ends up with N/2 2-point DFTs. The DIF FFT algorithm with simplified butterfly 
computation and with the output data in the bit reversed order is illustrated for a 
8-point DFT in Fig. 3.16. 
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Fig. 3.16 Signal flow graph of DIF(decimation-in-frequency) FFT algorithm (with simplified 
butterfly pattern) for computing an N = 8-point DFT 


3.6.3 Computation ofIDFT Using FFT Algorithm 

The inverse DFT is given by Eq. (3.4.3) as 

x[n] = IDFT, v {A(/t)) = ^ X(k)e j2nkn/lf 

= El'o 1 X (k)Wy kn for n = 0 : N - 1 (3.6.8) 

Comparing this with the DFT formula (3.4.2), we see that the computational pro¬ 
cedure remains the same except that the twiddle factors are negative powers of W,v 
and the output is scaled by 1 /N. Therefore, an inverse fast Fourier transform (IFFT) 
program can be obtained from an FFT algorithm by replacing the input data x[n]’s 
with X(ky s, changing the exponents of Wn to negative values, and scaling the last 
output data by 1/A. 

An alternative way to get the IDFT by using the FFT algorithm is derived by 
taking the complex conjugate of the IDFT formula (3.4.3) or (3.6.8) as follows: 

x*[n ] = i X*(k)W k N n = ^FFT{X*m- 

x[n\ = i (FFT{X*(k)} )* (3.6.9) 

It is implied that we can get x[ri\ = IDFT.vJATfc)} by taking the complex conjugate 
of X(k), applying the FFT algorithm for X*(k), taking the complex conjugate of the 
output, and scaling by 1/A. 

The MATLAB built-in functions “f ft (x, N) ”/“if ft (X, N) ” implement the 
N-point FFT/IFFT algorithm for the data x[n]/X(k) given as their first input argu¬ 
ment if the second input argument N is given as a power of 2 or if N is not given and 
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the length of the given data is a power of 2. If the length of the data sequence differs 
from the second input argument N, it will be zero-padded or truncated so that the 
resulting length will be N. 


3.7 Interpretation of DFT Results 

In general, the DFT takes a complex-valued sequence {x[n], n = 0 : /V — 1} and 
produces another complex-valued sequence {X(k), k = 0 : /V — 1}. Then, what 
is the physical meaning or practical usage of it? To understand it, let us take some 
examples where we think of a discrete sequence x\n\ as the discrete-time version of 
an analog signal x(t ) such that x[n] = x(nT). 

Example 3.16 DFT Spectrum of a Single-Tone Sinusoidal Wave [L-l] 

Suppose we have a continuous-time signal 

/15 \ 15 

x{t) = cos {wit) = cos I — nt J with a>i = —TZ (E3.16.1) 

Let us use the MATLAB function “f ft () ” to find the DFT spectrum of {x[n] = 
x(nT), n = 0 : N— 1} with different sampling interval T andDFT size or number of 
sample points N. Then we will discuss how we can read the frequency information 
about x(t) from the DFT spectrum, which has different shape depending on the 
sampling interval T and DFT size N. 


(a) Let the sampling interval and number of samples (DFT size) be T = 0.1 and 
N = 16, respectively so that the discrete-time sequence will be 


•(!”)• " =0 ’ 13 


The magnitude spectrum of this sequence, i.e., the magnitude of X a (k) = 
DFTi6{x„[«]} is depicted in Fig. 3.17(a). It has a spike at the frequency index 
k = 3 corresponding to the digital and analog frequencies as 


This analog frequency agrees exactly with the real frequency of the original 
signal (E3.16.1). Note that \X a (k)\ has another spike at the frequency index 
k = 13, which virtually corresponds to k = 13 — N = —3, but it is just like the 
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Fig. 3.17 DFT spectra of discrete-time sinusoidal sequences having a single tone 


mirror image of k = 3. It can be assured by writing the discrete-time sequence 
(E3.16.2) as 



= (8e^' 27r3n/16 + 8e y2jr(13) " /16 ) = ^ X(k)e j2nkn/N 

This explains why the magnitude of the DFT spectrum has two spikes of 8 at 
k = 3 and N - 3 = 13. 

(b) Let the sampling interval and number of samples (DFT size) be T = 0.05 
{up-sampling) and IV = 16, respectively so that the discrete-time sequence 
will be 


x b [n] 




(E3.16.5) 


The magnitude spectrum of this sequence, i.e., the magnitude of X b (k) = 
DFTigfx&l/i]} is depicted in Fig. 3.17(b), which looks quite different from 
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Fig. 3.17(a). That is, so many nonzero values show up here and there in the 
magnitude spectrum, though the highest two values occur at k = 1 and 2. It is 
because the picket fence effect (due to the frequency domain sampling of DFT) 
hides the spectral peak, allowing the many side lobes (resulting from the spec¬ 
tral leakage due to the time domain windowing) to be seen. This is a contrast to 
the other cases where the picket fence effect coincidentally hides the side lobes 
except the main peak as if by magic. Still we might fake a “far-fetched” story 
about the frequency corresponding to k = 1.5 (between 1 and 2) as 


(E3.16.6) 


This agrees with the result of (a), showing the right frequency information. 

(c) Let the sampling interval and DFT size be T = 0.05 ( up-sampling ) and N = 32 
(more sampling), respectively so that the discrete-time sequence will be 


, /15 \ (3 \ 

1 = cos I —JTt I = COS I 7 xn I , 

V4 / (= n r=o.o5n V16 ) 


i = 0, 1, , 31 

(E3.16.7) 


The magnitude spectrum of this sequence, i.e., the magnitude of X c (k) = 
DFT3 2 {x e [n]} is depicted in Fig. 3.17(c). Like Fig. 3.17(a), it has two spikes 
at k = 3 and N — 3 = 29 with only a difference in their amplitude (16), which 
is two times as large as those in (a) because of the increased number of samples 
(N = 32). Thus we can read the digital and analog frequencies as 


= 3 ^ 0 = 3^ = ^ = ^ [rad/sample] 


This analog frequency also agrees exactly with the real frequency of the original 
signal (E3.16.1). 

(d) Let the sampling interval and DFT size be T = 0.1 and N = 32 (longer 
interval/more sampling), respectively so that the discrete-time sequence will be 


x d [n ] = cos | = c 


n = 0, 1, , 31 

(E3.16.9) 


The magnitude spectrum of this sequence, i.e., the magnitude of X d (k ) = 
DFT32{xrf[n]} is depicted in Fig. 3.17(d). It has two spikes at k = 6 and 
N — 6 = 26, which tells us about the existence of the digital and analog 
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frequencies as 


3ir 'Sit, ., , 
— = — [rad/s] 


This analog frequency also agrees exactly with the real frequency of the original 
signal (E3.16.1). 


Example 3.17 DFT Spectrum of a Multi-Tone Sinusoidal Wave 
Suppose we have a continuous-time signal 


x{t) = sin(«i?) + 0.5cos(<W2t) = sin(1.5^t) + 0.5cos(37rt) (E3.17.1) 

with co i = 1.5;r and a>2 = 3n 


Figure 3.18 shows the four different discrete-time versions of this signal and their 
DFT spectra, which will be discussed below. 

(a) With sampling interval T = 0.1 and DFT size N — 32, the discrete-time 
sequence will be 

x a [n] = x(nT )| r=01 = sin(0.15jr«) + 0.5 cos(0.37rn), n = 0, 1, • • • , 31 

(E3.17.2) 


The magnitude spectrum depicted in Fig. 3.18(a) is large at k = 2 & 3 and 4 & 
5 and they can be alleged to represent two tones, one between kcoo = kQo/T — 
Ink I NT = Ink/3 .2 = 1.25 n and koj 0 = 1.875 n and the other between 
kcoo k = 2.5 n and ka>o k = 3.125 n. Of these two tones, the former corresponds 
to coi = 1.57r (with larger amplitude) and the latter to 002 = 3n (with smaller 
amplitude). 

(b) With shorter sampling interval T = 0.05 ( up-sampling ) and larger DFT size 
N = 64, the discrete-time sequence will be 

Xb[n] = x(nT)| r= o.o5 = sin(0.075^n) + 0.5cos(0.15^n), (E3.17.3) 

n =0, !, • •• , 63 


For all the up-sampling by a factor of 2, the magnitude spectrum depicted in 
Fig. 3.18(b) does not present us with any more information than (a). Why? 
Because all the frequency components ( w\ = 1.571 and a>2 = 3 n) are 
already covered within the principal analog frequency range [—n/T, n/T ] 
with T =0.1, there is nothing to gain by expanding it via shorter sampling 
interval. 
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(c) With the same sampling interval T =0.1, but with larger DFT size N = 64 (by 
zero-padding), the discrete-time sequence will be 


[ x a [n ] for n = 0, 1, • • • , 31 
[ 0 for n = 32, • • • ,63 


(E3.17.4) 


The magnitude spectrum depicted in Fig. 3.18(c) is large at k — 4 & 5 and 
9 & 10 and they can be alleged to represent two tones, one between kcoo — 
ktto/T = 2nk/NT = 2jtk/6.4 k = 1.25 it and kco 0 k = 1.5625 ;r and the other 
between ka)Q k = 2.8125 n and koj 0 *=° 3.125 n. Comparing this with the result 
obtained in (a), we see that larger DFT size by zero-padding can yield better 
resolution for the spectrum. 

(d) With the same sampling interval T = 0.1, but with larger DFT size N = 64 (by 
more sampling), the discrete-time sequence will be 


xa[n] = x{hT)\ t= q i = sin(0.157rn) + 0.5 cos(0.3^n), n = 0, 1, - - - , 63 

(E3.17.5) 
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The magnitude spectrum depicted in Fig. 3.18(d) is strikingly large at k = 5 
and 10, which can be alleged to represent two tones of ka>o = 2nk/NT = 
2nk/6A k = 1.5625 it and ka>o *=°3.125 it. Comparing this with the result 
obtained in (a), we see that larger DFT size by more sampling can improve 
the spectrum resolution. Comparing this with (c), we see that more sampling 
can yield better resolution than zero-padding as it collects more information 
about the signal. 


Example 3.18 DFT Spectrum of a Triangular Pulse 

Consider the following sequences that are obtained by sampling the continuous¬ 
time triangular wave x%(t) = 2(\ 2 (t) — \ 2 (t — 4)) of period 8 and with peak-to- 
peak range between —2 and +2. Let us consider the DFT magnitude spectra of the 
sequences that are depicted in Fig. 3.18. 

(a) With sampling interval T — 1 and DFT size IV = 8, the discrete-time sequence 
will be 

x a [n]=x s (nT)\ T=1 , n = 0,1, ■■■,7 (E3.18.1) 

The 8-point DFT magnitude spectrum of x a [n ] together with the CTFT mag¬ 
nitude spectrum of the single-period triangular pulse x%(t) (Eq. (E3.11.3)) is 
depicted in Fig. 3.19(a). 

(b) With shorter sampling interval T =0.5 (up-sampling) and larger DFT size 
N — 16, the discrete-time sequence will be 

x b [n\ = x 8 («r)| r=0 _5, n = 0, 1, • • • , 15 (E3.18.2) 

The 16-point DFT magnitude spectrum of x b [n ] together with the CTFT magni¬ 
tude spectrum of the single-period triangular pulse x 8 (t) is depicted in 
Fig. 3.19(b). It shows that the DFT is similar to the CTFT for the expanded 
principal analog frequency range [— n/T,n/T ]. 

(cf.) Note that to be compared with the DFT, the CTFT spectrum has been 
scaled not only vertically in consideration for the sampling interval T 
(Eq. (3.5.7) or Remark 3.7(2)) and the number of sample points, but 
also horizontally in consideration for the relationship between the digital 
frequency £2 and analog frequency oo= Q/T. 

(c) With the same sampling interval 7=1, but with larger DFT size IV = 16 (by 
zero-padding), the discrete-time sequence will be 


CM = 


a [n] for n = 0, 1, • • • , 7 
0 forn = 8, ••• , 15 


(E3.18.3) 
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Figure 3.19(c) shows that the DFT becomes closer to the DTFT spectrum, 
while it has the same principal analog frequency range for which it is similar to 
the CTFT. 

(d) With the same sampling interval 7=1, but with larger DFT size IV = 16 (by 
more sampling), the discrete-time sequence will be 


x d [n] = 


f x a [n] 
\x a [n- 8] 


for n = 0, 1, • • • , 7 
for n = 8, • • • , 15 


(E3.18.4) 


Figure 3.19(d) shows that we gained nothing with more sampling and larger 
DFT size in contrast with the case of Example 3.17(d). However, we lost 
nothing with more sampling. 

(e) With larger DFT size N = 16 by zero-insertion, i.e., inserting one zero between 
the samples, the discrete-time sequence will be 


\ x a [n/ 2] for n = 0, 2, • • • , 14 (even) 
x e [n\ = (E3.18.5) 

l 0 for n = 1, 3, • • • , 15 (odd) 

Figure 3.19(e) shows that zero-insertion results in the periodic extension of 
the DFT spectrum. This has an interpretation that zero-insertion increases the 
variation rate of the signal, producing the high frequency components. 

(f) With longer sampling interval 7 = 2 ( down-sampling or subsampling) and 
smaller DFT size N = 4, the discrete-time sequence will be 


(f [n] = x a [2n], n= 0, 1, - - , 3 


(E3.18.6) 
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Figure 3.19(f) shows that down-sampling compresses the principal analog 
frequency range and besides, smaller DFT size harms the spectrum resolution, 
(g) With longer sampling interval T — 2 ( down-sampling or subsampling), but 
with the same DFT size N = 8 (by zero-padding), the discrete-time sequence 
will be 


x g [n] = 


Xf[n ] for n =0, 1, • • • , 3 
0 forn = 4, 5, • • • , 7 


(E3.18.7) 


Figure 3.19(g) shows that zero-padding may help the spectrum to look better, 
but it does not recover the spectrum damaged by down-sampling. 

(h) With the same sampling interval T — 1, but with larger DFT size N = 16 
(by more sampling partly and zero-padding partly), the discrete-time sequence 
will be 


x h [n] = 


\ x d [n] 

l 0 


for n =0, I,- 
for n = 12, • • 


(E3.18.8) 


Figure 3.19(h) shows that zero-padding may help the spectrum to look better 
compared with (d). 


Remark 3.10 DFS/DFT (Discrete Fourier Series/Transform) and Spectral 

Leakage 

(1) Generally, the DFT X(k ) is complex-valued and denotes the magnitude & 
phase of the signal component having the digital frequency £2* = kQo — 
2 tz k/N [rad/sample], which corresponds to the analog frequency = kcoo = 
kQ 0 /T = 2nk/NT [rad/s]. We call £2 0 = 2;r/A and co 0 = £2 0 /r (N: 
DFT size) the digital/analog fundamental or resolution frequency since it is 
the minimum digital/analog frequency difference that can be distinguished by 
the N -point DFT. Note that the frequency indices k = 0 and N /2 represent the 
DC component (£2 = 0) and the virtually highest digital frequency component 
(£2^/2 = N/2 x 2n/N = 7t), respectively. 

(2) As illustrated in Figs. 3.17(b) and 3.18(a)-(d), if a periodic signal does not go 
through a multiple of periods within the sampled signal range [0, NT), its DFT 
spectrum is dirty. This is because the spectral leakage is not hidden by the 
picket fence effect. It seems that we might avoid this problem by setting the 
sampled signal range so that it covers exactly a multiple of the period of the 
signal. However, it is only our desire because we hardly know in advance the 
frequency contents of the signal and besides, most signals have many frequency 
components. 

(3) The spectral leakage problem is always in the midst of DFT because it is 
inherently due to the time-domain windowing as can be observed in the DTFT 
spectrum of Fig. 3.5(b3). Then, how could the DFT spectra of Figs. 3.17(a), 
(c), and (d) be free from the spectral leakage? The fact is that we could not 
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see the existing spectral leakage (as shown by the DTFT spectrum plotted in 
dotted lines) because the picket fence effect [D-l] of DFT (attributed to the 
frequency-domain sampling of DTFT) coincidentally happens to hide the many 
side lobe ripples except the main peaks. 

(4) From another point of view, we might put the responsibility for spectral leakage 
on the assumption of DFT that every signal is periodic with period equal to 
the DFT size, which is hard to be true. As a measure to alleviate the spectral 
leakage problem, there is a smooth windowing technique [W-l] that can reduce 
the “faked” abrupt change of the signal (at both ends of the signal range) caused 
by the rectangular windowing. Interested readers can see Problem 3.14. 

Through the examples given above, we have already observed how the DFT spec¬ 
trum is affected by the sampling interval, DFT size, zero-padding, and so on. The 
observations are summarized as follows: 

Remark 3.11 The Effects of Sampling Period (Interval) T and DFT Size N 
on DFT 

(1) Shorter sampling interval expands the principal analog frequency range 
[—n/T, n/T ] so that it can help higher frequency components to be reflected 
on the DFT spectrum if every frequency component is not covered within the 
present principal analog frequency range. 

(2) Larger DFT size (by zero-padding or more sampling) may help the (discrete) 
DFT spectrum to become closer to the (continuous) DTFT spectrum and that 
with better frequency resolution. 


3.8 Effects of Signal Operations on DFT Spectrum 

In this section, we summarize the formulas for finding the DFTs of different versions 
of a signal from the DFT of the original one. They will be of help in understanding 
the effect of self-repetition, zero-padding, zero-insertion, and so on. 

Let the DFT of a finite-duration sequence x\ri\ be 

X{k) = x[n\e~ j2,!knlN 

= XT-To x W w n with w n = e~ j2n/N for k = 0 : N — 1 (3.8.1) 

(a) Flipping: x a [n] = x[N - 1 — n] 

X a (k) = ^; o ' x[N - 1 - n]< n ^ N =~ m J2° m=N 1 x[m]W^-^ 
m = l X W W N k " W N k = X ( N ~ V W N k 


(3.8.2) 
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(b) Frequency-shifting: x b [n ] = (-1 ) n x[n] 

X b (k) = (-1)"* [n] W k N n 

= W k N n W^ /2)n = X(k + N/2) (3.8.3) 


(c) Zero-Padding: x c [n] = 


[xM 

\ 0 


for n = 0,1, • • • , N — 1 
for n = N, ■ ■ ■ , 2N - 1 


X c (k) = Y? N _ * xdnWiN = * x[n]W% /2)n = X(k/2) (interpolation) 

(3.8.4) 


(d) Self-Repetition: x r j[n] = 


[ x[n ] 
[x[n-ATj 


for n = 0, 1, • • • , N — 1 
for n 2N - 1 


x d(k) = Y,Zo 1 Xrf[n]W ^ = HZo x M W N /2)n + TZZ X[n ~ N ^ W n /2) " 

*M< 2)n + ElZ *[»] K™** 

= x ^ W N /2)n + El'o 1 x[n]W (k/2)n W^ /2)k (3.8.5) 

I 2X(k/2) for k even 

(zero-insertion) 

0 for £ odd 

(e) Zero-Insertion: jt e [n] = |* 1; [n/2] 

| 0 forn odd 

&(*) = E'Io" lxe[n] ^ = EZe"ven X [n/2] W ™ 

^ Ello X[w] ^2v mm =" E„to' X[ " ] W " = * {k) 


X(k) for It = 0, 1, • • • , N — l . ,, .. . 

JST(Jt - N) fork = N, • • • , 2N - 1 ( self - repetltlon ) ( 3 - 8 - 6 ) 
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(f) Down-sampling, Subsampling, or Decimation: x An] = x[2 n], n = 0, 1, • • • , 

f - 1 

*/(*> = E fl= o * [2n] </2 = E m=0 x[OT] 2 

m = n \ El; 1 x[n] +1 e!; 1 x[n] w% +N/2)n (3.8.7) 

= -(X(k) + X(k + N/2)) for k = 0, 1, •••,-- 1 (blurring) 


3.9 Short-Time Fourier Transform - Spectrogram 

The short-time or short-term Fourier transform (STFT) breaks a long signal into 
small segments, optionally overlapped and/or windowed, and finds the DFT of 
each (windowed) segment separately to record the local spectra in a matrix with 
frequency/time indices: 

STFT{x[«]} = X[k, n ] = x[m + n]w[m]W k N m (3.9.1a) 


'™e: 


x[m]w[m - nW k N m ~ n) fork = 0, 1, • • • , N - 1 

(3.9.1b) 


4s*g&3-f26’.m : to plot Fig.3.20 
clear, elf 

T-0.1; "■t'Br 1/T; % Sipnpling: period and Sainpli^|f:'^frequency 

Wl-2d*p:/l6; w2=30*pi/16; w3=40*pi/16; w4=60*pi/16; 

n= [0 : 31 ] ; x= [cos (wl*T*n) sin (w2*T*n) cos (w3*T*n) sin (w4*T*n) ] ; 

length(x); nw=0:Nx-l; % Length and duration (period) of tfte signal 
kk=0:ff=kk*Fs/N; % DFT size and ffjgquerioy range 
wnd= hamming(N)% Hamming window of length N 
Xovcr t ap-"N/4; % the rrarr.ber-.of ovoirt ap 

M=N-Noverlap; % the time spacing between DFT computations: 
for i=l:fix((Nx-Noverlap)/M) 

xiw= x ( (i—1) *M+[1:N]) .*wnd; % ith windowed segment 
Xi= fft(xiw); % DFT X(k,i) of *6h windowed segment 
X(:,i)= Xi(kk+1).'; % insert X(0:N/2,i) into the ith column 
tt (i) = (N/2+ (i —1) *M) *T; 

end 

% Use the MATLAB signal processing toolbox function specgram() 
[X_sp,ffl,ttl] = spectrogram(x,wnd,Noverlap,N,Fs,' yaxis' ); 

% Any dis.cst?@paBpy '&etwean the aboye result and spectrogram () ? 

discrepancy- norm(X-X.sp) /norm(X.sp) 

figure(2), elf, colormap(gray(256)); 

subplot(221), imagesc(tt,ff,loglO(abs(X))) , axis xy 

subplot (222), imagesc(ttl, ffl,loglO(abs(X_sp) )) , axis xy 

% specgram(x,N,Fs,wnd,noverlap) in MATLAB of version 6.x 


where the window sequence tn[m] is used to select a finite-length (local) segment 
from the sliding sequence x[m + n] and possibly to reduce the spectral leakage. 
Note that the frequency and time denoted by frequency index k and time index n of 
X[k, n ] are 
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(a) A non-stationary signal with time-varying frequency content 






(dl) X[k,ri\ obtained with N=32 and (d2) X[k,n] obtained with N= 48 and 
Noverlap = 8 Noverlap=12 


Fig. 3.20 Short-time Fourier transforms with different time/frequency resolution 

A = ^ = y f s [Hz] and 4= (y+«)T[sec] (3.9.2) 

where t„ is set to the center of the sliding window (Fig. 3.20(b)). If we take the 
STFT not for every n but only for n = iM (a multiple of M), each segment 
gets overlapped with its neighboring one(s) by Noverlap = N — M samples. 
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Note that M determines the width of interval time between the DFT computations. 
The MATLAB function “spectrogram () ” can be used to find the STFT (see 
Appendix E.8). 

We run the above MATLAB program “sig03f20.m” to get the STFT X[k, n] 
of x[ri\ (Fig. 3.20(a)) as depicted in Fig. 3.20(dl) (with DFT size N = 32 and 
Noverlap = 8) and (d2) (with N — 48 and Noverlap = 12), which show that the 
frequency becomes higher as time goes by. Such a STFT can be used to determine 
and display the spectrum of a non-stationary signal (such as speech or music) whose 
frequency content changes with time. 

Now, comparing Fig. 3.20(dl) and (d2), let us consider the effect of segment or 
window duration NT on the time and frequency resolutions of the STFT. We might 
say that the time resolution is NT [sec] (the segment duration) and the frequency 
resolution is 1 /NT [Hz], This implies that if we increase or decrease the segment 
duration, the time/frequency resolution gets poorer/better or better/poorer, show¬ 
ing the trade-off between the time and frequency resolutions. It is an illustration 
of uncertainty principle (Remark 2.9(1)) that both time resolution and frequency 
resolution cannot be improved. Although the boundary of the uncertainty principle 
(best simultaneous resolution of both) is reached with a Gaussian window function, 
the wavelet transform or multi-resolution analysis was devised, which can give a 
good time/frequency resolution for high/low-frequency components. 


3.10 Summary 

In this chapter we have defined the discrete-time Fourier transform (DTFT) and the 
discrete Fourier series(DFS)/transform(DFT) for discrete-time signals and exam¬ 
ined their properties together with their relationship. The DFT of a discrete-time 
sequence x[n ] has been shown to correspond to one period of the discrete-time 
Fourier series for the periodic extension of x\ri\. We have also discussed the FFT 
algorithms that deserve the overwhelming popularity owing to their computational 
efficiency. This chapter also introduced some examples, which give you some inter¬ 
pretation of the DFT and will hopefully help you to gain an insight into physical 
meaning or practical usage of the DFT. It ended up with the introduction of the short- 
time Fourier transform (STFT), which can easily be obtained by using a MATLAB 
function “specgram () ” in 6.x versions and “spectrogram () ” in 7.x versions. 


Problems 

3.1 Properties of DTFT (Discrete-Time Fourier Transform) 

(a) Prove the frequency-shifting property (3.2.7) by using the DTFT formula 
(3.1.1) or IDTFT formula (3.1.3). 


:[ri\e mn & X(£l - no 


0*3. LI) 
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(b) Prove the convolution property (3.2.8). 

yin] = x[n]*g[n] 4 7(f2) = X(C2)G(S2) (P3.1.2) 


(c) Prove the modulation property (3.2.9). 

y[n] = x[n ] m[n] 4 7(£2) = ^X(£2)*M(£2) (P3.1.3) 

2jz 

(d) Prove the summation property (3.2.11) by using the convolution property 
(3.2.8) together with Eq. (E3.8.6). 

El = _oo x[m]=x[n]*u s [n]^ 

- —+ nX(0) V°° <5(f2 - 2 ni) 

1 — e~ ] ” z —oo 

(P3.1.4) 


3.2 Discrete-Time Hilbert Transformer 


(a) Prove that the impulse response of a system, called the Hilbert trans¬ 
former, with frequency response 


H(Q) = 


—j for 0 < £2 < n 
+j for — it < £2 < 0 


(P3.2.1) 


h[n] = 


21 nit for n : odd 
0 foru : even 


(P3.2.2) 


%sig03p_02.m 

EPS=le-10; Xx 200; nx=[-Nx:Nx]; Wl=0.1*pi; xn= cos (Wl*nx) ; 
Nh=50; nh=[-Nh:Nh]; hn= (mod(nh,2)==1).*(2/pi./(nh+EPS)); 
yn= conv(hn,xn); ny=Nh+Nx+l+nx; ynl= yn(ny); 

W= [-50:-1 1:50]*(pi/50); 

X= OlfT(xn,W); Xmag= abs(X); Xphase= angle(X); 

Xphase= (abs(imag(X))>=EPS),*Xphase; 

H= ®f»Ttbn,W); Hmag= abs(H); Hphase= angle (H); 
y= (yn,w); Ymag= abs(Y); Yphase= angle (Y); 

subplot(331), plot(nx,xn), axis([nx([l end]) -1.5 1.5]| 
subplot (332), plot(W,Xmag), subplot(333), plot(W,Xphase) 
subplot (334) , plot (ntiyhn) , axis([nh([l end]) -1 1]) 
subplot (335) , plot (W, Hmag) , subplot .1336) , plot(W,Hphase) 
subplot(337), plot(nx,ynl, nx,sin(Wl*nx) ,' r' ) 
subplot(338), plot(W,Ymag), subplot(339), plot(W,Yphase) 
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(b) By taking the IDTFT of Y(Q.) = ff(£2)X(£2), prove that the output of the 
Hilbert transformer to a sinusoidal input x\ri\ = cos(£2o«) is 

y[n] = sin( £2 0 n) (P3.2.3) 

(c) We can run the above program “sig03p_02.m” to rest assured of the 
fact that the output of the Hilbert transformer to x[n] = cos(0.l7rn) is 
y[n ] = sin(0.1 nn) where y[n\ = h[n]*x[n\ has been obtained from the 
time-domain input-output relationship. Identify the statements yielding 
the impulse response h[n], output y[n], and frequency response H(Q,). 

3.3 Discrete-Time Differentiator 

(a) Prove that the impulse response of a discrete-time differentiator with 
frequency response 

H(Q) = jSi (P3.3.1) 

is 

h [n] = (_l) (P3.3.2) 

(b) By taking the IDTFT of Y(Q.) = H(Q.)X(£l), prove that the output of the 
differentiator to a sinusoidal input x[ri\ = sin(£2 0 n) is 

y[n] = S2 0 cos(S2 0 n) (P3.3.3) 

(c) By reference to the program “sig03p_02.m”, compose a program and run 
it to rest assured of the fact that the output of the differentiator to x[n] = 
sin(0.l7ru) is y[n] = 0.17T cos(0.l7rn) where y[ri\ =h[n]*x[n] has been 
obtained from the time-domain input-output relationship. 

3.4 BPF Realization via Modulation-LPF-Demodulation - Frequency Shifting 
Property of DTFT 

Consider the realization of BPF of Fig. P3.4(a), which consists of a modulator 
(multiplier), an LPF, and a demodulator (multiplier). Assuming that the spec¬ 
trum of x\n] is as depicted in Fig. P3.4(b), sketch the spectra of the signals 
s[n], w[n], and y[n], 

3.5 Quadrature Multiplexing - Modulation (Complex Convolution) Property 
of DTFT 

Consider the quadrature multiplexing system depicted in Fig. P3.5 where the 
two signals are assumed to be bandlimited, i.e., 


Xi(£2) = X 2 (£2) = 0 for Q > 


(P3.5.1) 
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A BPF realization via modulation-LPF-demodulation 



-27r —7T —7 t/2 0 7t/2 7t 2tt 

(b) The spectrum of the input signal x[n\ 


Fig. P3.4 



Assuming that the channel is ideal so that r[n] = ,v[«], express the spectra 
S(£2), Vi(£2), V 2 (£2), Fi(£2), and Y 2 (£2) of s[n], t>i[n], v 2 [n], yi[n], and 
y 2 [n\ in terms of X\(Q.) and X 2 (£2). 

3.6 Windowing (Complex Convolution) Property of DTFT 
Referring to Example 3.10, answer the following questions: 

(a) In the program “sig03el0.m”, increase the (rectangular) window size 
parameter M and run the program to see the window spectrum and the fre¬ 
quency response of the designed FIR filter. Based on the results, describe 
the shape of the filter frequency response when M is set to infinity. 

(b) With the window size parameter M set to 3 as it was, change the shape 
of the window into, say, one of the following: Bartlett (triangular), Ham¬ 
ming, Hanning, Blackman, and Kaiser. Note that the window sequences 
can be generated (as column vectors) by the MATLAB commands, 
bartlettf), hamming () , hanningO, blackman(), and 
kaiser (), respectively. Has the ripple of the frequency response been 
reduced? 
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3.7 DTFT and CTFT of a Finite-Duration Signal 


%.';:g03'p Ot.rr. 

% Fig. 3.7(To tell the relationship between CTFT and BlfSf 
EPS=le-10; T=1; t 

£-[-500:900] /N + EPS; % Normalized frequency range 
W=2*pi*f; w=W/T; % Digital/Analog frequency range 

X_CTFT= Xw (w) ; X_CTFTjnag= abs (X.CTFT) ; 

Sutn-Cif-X_CTFTs= (Xw (w+2*pi/T) +Xw (w) +Xw (w-2*pi/T) ) /T; 

X_DfFT=DTFT (xn,W) ; X-DTFT_mag= abs (XJ5TFT) ; X_DTFT_pt»w angle (X.DTFT) ; 
Discrepancy-between-CTfT^TFfe’SormtXltiiFT-SBiti-of-X.tJT^Ss) /norm (X.DTFT) 
subplot(321), stem(t,xn,'.'), hold on, plot(t,xn,':') 
subplot (323) , plot (W,X_DTFTjmag, 'b', W, x_CTFT_mag/T,' k:' ) 
hold on, plot (W, abs (Sum.of JCCTFTS) ,' r: 


The objective of the above program “sig03p 07.m” is to plot the CTFT spec¬ 
trum X\(co)/T of the unsampled dual triangular pulse signal x\(t) given by 
Eq. (E3.11.3) and the DTFT spectrum X | (£2) of the triangular pulse sequence 
x\[n ] = x\{nT) with 7=1. Also, it plots the sum of three CTFTs shifted 
by — 2n/T, 0, and +2 n/T along the analog frequency co = Q./T and scaled 
by 1/T to check the validity of the relationship between the CTFT and DTFT 
described by Eq. (3.5.7). Modify the program so that it does the same job 
with sampling interval T = 0.5. What can we get by shortening the sampling 
interval? Refer to Remark 3.7(2). 

3.8 DFT/DFS, DTFT, and CTFS of a Noncausal Signal 

Consider the dual triangular pulse sequence which would be obtained by 
sampling x\(t) in Fig. 3.7(al) with sampling interval T = 0.5. 

(a) Use the MATLAB function “fft () ” to get the N = 16-point DFT 
X N (k) of the sequence and plot its magnitude together with the DTFT 
magnitude against £2* = [0 : N — 1] x (2n/N) and Q — [—500 : 
500] x (27T/400), respectively. Note that the DTFT might have been 
obtained in Problem 3.7. 

(b) Noting that the CTFS coefficients X k are the samples of the CTFT X(oj) 
(Eq. (E3.11.3)) at w = kco 0 = 2nk/P = Ink/NT as described by 
Eq. (2.2.4) or stated in Remark 2.7(2), find the relative errors between 
the DFT X N (k) and two partial sums of the shifted CTFSs and compare 
them to argue for the relationship (3.5.3) between the DFT and CTFS. 


Ei 


\\X N (k)-X k /T\\ 

ll*tf(*)ll 


and 


E 2 = 


l|Xy(fc) ~ (X k+N + X k + X k _ N )/T || 


\\X N (k)\\ 


(P3.8.1) 
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<Hint> You might need to combine some part of the program “sig03p_ 
07.m” with the following statements: 



3.9 CTFS, CTFT, and DFT/DFS of a Noncausal Sequence 


— x(t) (a triangular pulse) 

— x 2 (f) (periodic extension with period 2) 
—• x 2 [n] (discrete-time version) 



-3 -2 -1 -0.5 0 0.5 1 2 3 

Fig. P3.9 


Consider the triangular pulse signal x(t) of Fig. P3.9, its periodic extension 

X 2 (t) with period P — 2, and its sampled periodic version xjj) = X 2 (t)&r(t) 

with sampling interval T = 0.5. 

(a) Find the CTFT X(co) of x(t). You can use Eq. (E2.3.4). 

(b) Find the CTFS X k of X2O). You can use the result of (a) and Eq. (2.2.4) 
stating that the CTFS coefficients are the samples of the CTFT at co = 
ka>o = 2jzk/P. 

(c) Show that the N = 4-point DFT of the discrete-time version x[n] is 

X(k) = [2101] (P3.9.1) 

(d) Show the validity of the relationship between the CTFS and DFT described 
by Eq. (3.5.3) for this case, i.e., 

X(k) (P = 91) [2 1 0 1] = i Y2=-oo Xk+ml 


(P3.9.2) 
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<Hint> You might need the following formula 

(P3 - 9 - 3) 

which can be derived by substituting A = 1, D/P = 1/2 into 
Eq. (E2.1.6) as 


AId/pII) <E =' 6> p _, r . Alh ' ric ~ (/ / ) A 2 


1 ( for k- 

-A 1 


i {kn/2)- 


'—Y 

■/2 ) 2 J 


1 = 1 y 00 _ 1 _= 2 y 00 _ _ _ 

2 2 00 (2rn + l) 2 7r 2 /2 2 ^m =-00 (2m + l) 2 ;r 2 

= 4 y°° _ - _ 

*-~>m=0 (2m + 11 2 7T 2 


3.10 DTFT andDFT of Discrete-Time Periodic Sequences 

When we need to find the DTFT of a periodic sequence x N [ri\ with period N, 
we first get its DFS representation 


x N \n\ ^ ^ Yl n ^N(k)e i2nknlN (P3.10.1) 

IDFT N x~>k=0 

with X N (k) (3 = 2) Y N ~' x N [n]e~ j27tkn/N 

DFT *—‘n= 0 

and then use Eq. (3.1.5) to obtain the DTFT of x,vM as 

c-iuw 


(a) Verify the validity of this DTFT pair by showing that the IDTFT of 
(P3.10.2) is x N [n], 


F“ 1 {X(fi)} (3 = 3) — f X(Q.)e jan dQ. 
2?r J ln 

(P3O0- 2 ) J_ 1 

(1.1.25) N ^k =0 


= x N [n] (P3.10.3) 
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(b) Use the DTFT relation (P3.10.2) to show that the DTFT of the discrete¬ 
time impulse train 

8 N \ri\ = 8[n—mN] (also called the comb sequence) (P3.10.4) 


27T \—\ oc 


I =— y°° 

' N k= 


2jtk \ 

~w) 


0*3.10.5) 


3.11 Effect of Discrete-Time Sampling on DTFT 

As a continuous-time sampling with sampling interval T can be described by 

x*(t) <E2 = 31) A:(t)5r(t) (8 r (t) = ^ 8(t — mT ) : the impulse train) 


so can a discrete-time sampling with sampling interval N be described by 

x*[«] = x[n]5;v[n] (<5jv[n] = 8[n — mN ] : the impulse train) 

0*3.11.1) 

(a) Use the DTFT modulation property (3.2.9) or B.4(9) and Eq. (P3.10.5) to 
show that the DTFT of this sampled sequence x*[n] can be expressed in 
terms of that of the original sequence x\n] as 

1 r —\oo ( 2nm\ 

= j_ V'' 00 -)- mQ ) with Q s 

N *—<m=-oo 

(b) Show that the DTFT of a decimated sequence x d [n] obtained by removing 
the zeros from the sampled sequence x*[«] = x\n\8 N [ri\ is 

0*3.11.3) 

(cf.) This conforms with Eq. (3.2.14), which is the scaling property of DTFT. 

(c) Substitute Eq. (P3.11.2) into Eq. (P3.11.3) to show that 


= — (P3.11.2) 


1 \—l / Zjitn \ 

X d (Q) = — > A — + - 

J N L ^ m=0 \n N 


0*3.11.4) 
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Substitute this into Eq. (P3.11.4) to show that 


2nk\ 
~NT ) 


(P3.11.6) 


(e) Verify the CTFT relation between the signal and its spectrum depicted in 
Figs. P3.11(a2) and (b2): 

x a (t) = Xq(() = sine 2 ** ^—2 r n {(o) * 2 r n ((o) (triangular pulse) 

(P3.11.7) 

Also verify the DTFT relation between the signal and its spectrum depicted 
in Fig. P3.11(a3) and (b3): 

x[n] = xl[n ] = sine 2 <5- -'-4r T / 2 (Q) * Ar n n(D.) (triangular pulse) 
V4/ 2 7r 

(P3.11.8) 

(f) Show that the DTFT spectrum X(Q.) of x[n\ (Fig. P3.11(a3)) can be 
expressed in terms of the CTFT spectrum X a (co ) of x a (t) (Fig. P3.1 l(a2)) as 


X(£i) = 2 Y^__ oo x a(2(^i-2jrk)) (P3.11.9) 


Show that the DTFT spectrum X\(Q) of x\[n] (Fig. P3.11(a4)) can be 
expressed in terms of the DTFT spectrum X(Q) of x[n\ (Fig. P3.1 l(a3)) as 

Xi(fl) = l - (X(£2) + X(Q + ji)) (P3.ll.10) 

Show that the DTFT spectrum X d (£2) of x d [n] (Fig. P3.11(a5)) can be 
expressed in terms of the DTFT spectrum X(Q) of x[n\ (Fig. P3.1 l(a3)) as 

x d m = (P3.ii.ii) 

Show that the DTFT spectrum X 3 (£2) of x 3 [n] (Fig. P3.11(a6)) can be 
expressed in terms of the DTFT spectrum X d (Q.) of x[n] (Fig. P3.1 l(a5)) as 

1 


x 3 (£2)= ~{X d {n) + X d (Q. +7T)) 


(P3.ll.12) 
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Show that the DTFT spectrum X 4 (£2) of x 4 [n] (Fig. P3.11(a7)) can be 
expressed in terms of the DTFT spectrum X d (Q) of x d [n] 
(Fig. P3.11(a5)) as 

X 4 (£2) = 1 (x d (£2) + (n + + X d (£l +n) + X d (n+ 

V (P3.ll.13) 

Show that the DTFT spectrum X 5 (£2) of xs[n] (Fig. P3.11(a8)) can be 
expressed in terms of the CTFT spectrum X u (oj) of x a (t) (Fig. P3.1 l(a2)) as 

^5(0) = \ YZ =-oo ( ° + 2 2W7r ) (P3.ll.14) 

(cf.) The sampled sequences xt, [n], x 4 [n], and xs[n] are all identical to 
the impulse sequence and their flat spectra illustrate the extreme 
case of a spectrum blurred by downsampling. 

3.12 Linear Convolution and Correlation Using DFT 
Consider the following two sequences: 

x[n] = [1 2 3 4 5 6 7 8] and y[n] - [1 -2 3] (P3.12.1) 

(a) Referring to Remark 1.5, determine the length of the linear convolution 
or correlation of the two sequences. Also use the MATLAB command 
“nextpow2 () ” to find the smallest power of 2 that is greater than or 
equal to the expected length of the linear convolution or correlation. What 
is the minimum size N of DFT that can make the FFT operation most 
efficient for computing the linear convolution or correlation? 

(b) Referring to Sect. 3.4.2, use the /V-point FFT to compute the linear con¬ 
volution of x\n] and y\n]. Check if the result conforms with that obtained 
by using “conv (x, y) ”. 

(c) It seems that we can use the /V-point FFT to compute the correlation of 
x\n] and y[n] based on the following facts: 

o kyw (iA = b) x[ni* m - n] ( ~ p3 - u ^ 
o x[—n] 4 X(-Q) implies that DFT, v {>-[/V - «]) = Y(N - k ) 

(P3.12.3) 

Noting that y[N — n ] can be programmed as “ [y (1) fliplr (y (2 : 
end) ) ] ”, compose a program to compute the correlation and run it to 
get 4> xy \n\. Check if the result conforms with that obtained by using 

“xcorr (x, y) ”. 
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3.13 DFT Spectra of Sampled Signals 





20 

T 


mill 

JL_!5!2L 

WtlD 111 

Ttttt , /, 0 mnrlfll 

kJSS — —nl 


(a) (b) 


30 

20 


30 

20 




10 

,|J,.!*?.“>!.,y 

10 


. \x d (k)\ 

htntTNt. . I, 

°0 

8 16 32 48 

(c) 

e r k ° ( 

) 8 

16 32 48 

(d) 

63 


Fig. P3.13 DFT spectra of several discrete-time signals 


With the sampling period T = 0.1 [s], we have sampled the following signals 

(1) 0.5 cos 37ft + sin27ff 

(2) cos37rM- 0.5 sin 27ft 

(3) 0.5 cos 47ft + sinjrt 

(4) cos Ant + 0.5 sin nt 

(5) 0.5 cos 237 xt + 0.5 sin 2nt — 0.5 sin 187ft 

(6) 0.5 sin 2l7f t + 0.5 cos 247ft + 0.5 cos 167ft 

and obtained their DFT spectra as depicted in Fig. P3.13. 

(a) Find the corresponding spectrum for each signal from the DFT spectra 
depicted in Fig. P3.13. 

(b) If these signals have been through an anti-aliasing prefilter, which one is 
expected to have the DFT magnitude spectrum like \X a (k)\l 

3.14 Spectral Leakage and Windowing Technique 

Let us think about the cause of spectral leakage illustrated in Fig. 3.17(b) 
and some measure against it. As discussed in Remark 3.10(2), the spectral 
leakage stems from that any sequence is supposed to have periodicity with 
period N (equal to the DFT size), regardless of its peridocity, just because it is 
an object sequence of an IV-point DFT. More specifically, the sequence Xb[n] 
is supposed to be periodic with period N = 16 as depicted in Fig. P3.14(a), 
which shows such abrupt changes as discontinuities at both ends. A measure to 
reduce this abrupt change is to multiply a window sequence whose magnitude 
decreases gradually at both ends rather than cuts off abrubtly as the rectangular 
window does. Figure P3.14(b), (c), (dl), and (d2) show a triangular (Bartlett) 
window wj[n ] of length N — 16, the windowed sequence xi,[n]wr[n], and 
the DFT spectra of Xh\n\ and Xb\n\wr\n\. Comparing the DFT spectra of 
unwindowed and windowed sequences, we can see that the windowing has 
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(a) A sequence x b [n] with its periodicity assumed due to the 16-point DFT 



0 7 8 15 

(b) A triangular (Bartlett) window of length A/= 16 

, xJl”] w T [r>] 



(c) The windowed sequence and its periodic extension with period N= 16 




4 

DFT { 

xJn]w[/7]} 

X b (K) = 

DFT {iyu]} 

mill 

_i| 

IllTTT , . , 

.T 


T. 




-8 -4 

0 

4 8 


(dl) The DTF spectrum of unwindowed sequence (d2) The DTF spectrum of windowed sequence 
Fig. P3.14 The effect of windowing on the DFT spectrum 


the effect of reducing the spectral leakage. You can try with another window 
such as the Hamming window or Hanning (raised-cosine) window. 

3.15 Spectrum Blurring due to Down/Sub-sampling (Slower Sampling) 

As can be seen in Fig. 3.19(f) or Eq. (3.8.7), slower sampling (sub-sampling) 
may make the spectrum blurred. 

(a) Noting that x/[n ] in Fig. 3.19(f) has been obtained from downsampling 
x a [n] by a factor of 2, sketch the DFT spectrum of the sequence which 
will be obtained from downsampling x/[n] by a factor of 2. 

(b) Referring to Eq. (3.8.7), determine the condition on which the DFT 
spectrum is not blurred by downsampling it by a factor of 2. 

3.16 Parallel Computation of DFTs for Two Real-valued Sequences (Problem 4.10 
of [K-2]) 

We can compute the DFTs of two real-valued sequences x\ [«] and xoln] from 
the DFT Y ( k ) of a complex-valued sequence 


y[n] = x\ [n] + j x 2 [n] 


(P3.16.1) 
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where the DFT of each sequence can be written as 

Xi(k) = X lR (k) + j X u (k) = Yf n= o cos 

~ j E„ =0 XlM sin (~Y~) (P3.16.2a) 

X 2 (k) = X 2R {k ) + j X 2I (k) = x 2 [n] cos 

( 2nkn \ 

- J E„ =0 X2[n] sin (J (P3.16.2b) 

(a) Show that, since x,[n], i = 1 & 2, is real, X iR (k) = Re{X,(£)} is even 
and Xu(k) = Im{X,(£)} is odd via the conjugate symmetry (3.2.5) or 
Table B.5(4) so that 

X iR (k) = X iR (-k)r N [k] = X iR (N - k) 

s= X iR (N - k) for k = I,--- ,N- 1 (P3.16.3a) 

X u (k) = -X u (-k)r N [k] = -X U (N - k) 

= -X„(N-k) for k= I,--- ,N- 1 (P3.16.3b) 

where r w [£] = n s [fc] — u s [N — k] is a rectangular pulse sequence. 

(b) Show that the real and imaginary parts of Y (k) = DFT ;V {>’[«]} can be 
expressed in terms of X lR (k), X u (k), X 2R (k), and X 2 ,(k) as 

Y(k) = DFT w {y[n] = x, [n] + j x 2 [n]} = *,(*) + jX 2 (k) 
= X lR (k) + j X u (k) + j ( X 2R (k ) + j X 2I (k )); 

Y R ik) + j Yj(k) = X lR (k ) - X 2I (k) + j (X u (k) + X 2R (k)) (P3.16.4) 

(c) Show that we can use the above relations (P3.16.3) and (P3.16.4) to 
express the DFTs X \ (k) and X 2 (k) in terms of the real and imaginary 
parts of Y(k ) = DFT/v{y[n]} as 

X^k) = X lR (k ) + j X u (k) = l -{Y R {k) + Y r (N - k)) 

+ j\(Y,{k) - Y,{N - k )) = l -(Y(k) + Y*(N - k )) 

(P3.16.5a) 

X 2 {k) = X 2R {k) + j X 2l (k) = hj^k) + Y,{N - k)) 

- j\{Y R {k) - Y r (N - k)) = -j^{Y{k) - Y*{N - k )) 

(P3.16.5b) 
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(d) Compose a MATLAB function “[Xl,X2]=fft_2real(xl,x2,N)”, which uses 
Eq. (P3.16.5) to compute the DFTs of two given real-valued sequences xl 
and x2. Run it to get the DFTs of the two sequences x a [n] and Xb\n] 
of Fig. 3.17(a) and (b) simultaneously and plot them to check for its 
legitimacy. 

3.17 Half-Size DFT Computation of Real-valued Sequences in OFDM Communi¬ 
cation 

Suppose we have an OFDM (Orthogonal Frequency Division Multiplexing) 
communication system in which the transmitter converts a length N — 1 
complex data sequence (X(k), k = 1 : N — 1} into a length 2 N conjugate 
symmetric sequence 


Y(k) = 


0 

X(k) 

0 

X*(2N - k) 


for k = 0 

fork = 1, ••• , N - 1 
for k = N 

for k = N + l, ■ ■ ■ , 2N — 1 


(P3.17.1) 


and performs a 2N -point IFFT operation on { Y(k). k = 0 : 2 N — 1} to make 
a length 2 N real-valued sequence \y[n], n — 0 : 2 N — 1} to be transmitted. 
With a noiseless channel and an exact synchronization, the receiver performs 
a 2N -point FFT operation on the received sequence y[n] to get Y(k), and then 
restore X(k). Fet us consider how to exploit the conjugate symmetry to cut the 
DFT size by half. 

(a) Referring to Problem 3.16, we let the receiver construct a complex-valued 
sequence from the received sequence y[n] as 


w[n] (P3 = 1} Wl [j n ] + j Wl [ n ] 

= y [2n] + j y [2n + 1] fork = 0:A-l (P3.17.2) 


and take the /V-point FFT operation on w[n] to compute W(k) = DFT V 
{w[n]j. Then we can use Eq. (P3.16.5) to express the DFTs of u>i[n] and 
Wi [«] in terms of W(k) as 

Wi(k) = DFTjvjwiCn]} <P3 i|- 5a) l -{W{k) + W*{N - k)) (P3.17.3a) 

W 2 (k) = DFT, v {wj 2 [«]} (P3 = 5b) -j l -(W(k) - W*(N - k)) (P3.17.3b) 

Note that the 2 W-point DFT of the even-indexed sequence v[2n] = w\ [n], 
i.e., y[n] = w\\n/2\ (with zero-insertion) is the same as the repetition of 
W\(k) (Eq. (3.8.6)) and the 2/V-point DFT of the odd-indexed sequence 
y\2n + 1] = u> 2 [n] is the same as the repetition of W 2 (k)e~-' 2nk/2N 
(Eq. (3.8.6)) and the time-shifting property B.5(7)) since deploying w 2 [n] 
as y[2n + 1] amounts to a zero-insertion followed by time-shifting by 
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n — —1. Therefore the DFT of the original received sequence y\n] = 
y\2n] + y\2n + 1] can be written as 


Y{k) = W x {k) + W 2 {k)e~ jnk/N (KU Z= 3a ’ b) hjV(k) + W*{N - k)) 

- j^e~ j,lk/N (W(k) - W*(N - k)) (P3.17.4) 

This equation is used by the receiver for post-processing the FFT 
result. 

(b) On the other hand, the transmitter is required to perform a pre-processing 
operation on Y(k) to construct W(k) whose IDFT is the complex-valued 
sequence as 


w[n] (P3 = ' 2) u)] [ n ] + j w2 [ n ] 

= y [2 n] + j y [2n + 1] for k = 0 : N - 1 (P3.17.5) 


and take the N -point IFFT operation on W(k) to compute w [n \ — 
IDFTAr{lT(k)}. Then the transmitter is supposed to construct a length 
2 N real-valued sequence y[n] = y\2n] + y[2n + 1] (to be transmit¬ 
ted) such that y[2ri\ = w\ [n] and y[2n + 1] = w 2 [n]. To determine 
the pre-processing operation (at the transmitter) which is reverse to the 
post-processing one (at the receiver), let us write Eq. (P3.17.4) together 
with its Hermitian in matrix form as 


(P3.17.4) 

l ' 

] _ j e -jnk/N 

l+j e~ ink/N 

W{k) 

with its Hermit 

ian 2 . 

1 _ j e jn(N-k)/N 

1 _|_ j e jn(N-k)/N 

W*(N - k ) 


ik/N ] r mk) i 

*i»\ L^ ( iv-k)j ( p3 - 17 - 6 ) 


This implies that the pre-processing operation on Y(k ) to construct W(k) 
can be performed by 


r W(k) i n - j e~j* k ' N 1 + j e ~ jnk/N 1 1 r Y(k) 1 
L W*(N -k)\~ z [l+j e - jnk/N 1 - j e - ink/N J |_ Y*(N - k) J 

2 T i-je-M" -(i + je-Jxk/N^r Y {k) 1 

_ -j 4e-m/N l-d+j l - j e -mm J [ y*(N -k) J 
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%sig03p_17.m 
clear, elf 

N=1024; N2=N*2; kk=[-N:N]; 

n=[0:N-l]; k=[0:N-l]; WN_k=exp (j*pi*k/N) ; WNk=exp (-j*pi*k/N) ; 

Y= [0 2*(randint(1,N-1)+j*randint(1,N-1))-1]; % assumed data 
% Transmitter 

Y2= [Y 0 conj(fliplr(Y(2:N)))]; y2= ifft(Y2); % using 2N-point IDFT 
Yc= conj([Y(1) fliplr(Y(2:N))]); 

W= (Y+Yc + j*WN_k.* (Y-Yc) )/2; w= ifft(W); % using N-point IDFT 
y2_from_w= [real (w) ; imag (w) ] ; y2_from_w= y2_f rom_w (:) .' ; 
error_between_y2_and_y2_f rom_w= norm (y2-y2_f rom_w) /norm (y2) 

% Receiver 

y2_r= y2; Y2_r= fft (y2_r) ; % received sequence and its 2N-point DFT 
y_r= reshape (y2_r, 2, N) ; w_r= y_r (1, :) + j*y_r (2, :) ; 

W_r= fft (w_r) ; Wc_r= conj([W_r(l) fliplr (W_r (2 :N) ) ] ) ; 

Y_f rom_W= (W_r+Wc_r - j*WNk .* (W_r-Wc_r) )/2; 

error_between_Y2_r_and_Y_f rom_W=norm (Y2_r (1 :N) -Y_from_W) /norm (Y2_r) 


I r 1 + j e Jnk/ * 1 - j e jxk/N 1 r Y(k) 

~ 2 [l-j e^ N 1 + j ej* k ' N J [ Y*(N - k ) _ 


(P3.17.7) 


W(k) = l -{Y{k) + Y*(N - k )) + j X -e iltk/N {Y(k) - Y*(N - k )) (P3.17.8) 


The objective of the above program “sig03p 17.m” is to check the validity 
of this scheme by seeing if the result of using the N -point DFT agrees with 
that of using the 2 N -point DFT Identify the statements corresponding to 
Eqs. (P3.17.4) and (P3.17.8). 

3.18 On-line Recursive Computation of DFT 

We can compute the N -point DFT X(k,m ) of a long sequence x[n] multi¬ 
plied by a sliding rectangular window r N [n — m\ of length N in the following 
recursive way where we call each windowed sequence x\ri\r N \n — m] the m* 
data segment. 

Let us define the 0 th , m li \ and (m + 1)* data segments as 

{x 0 [0], jc 0 [1], • • • , *q [N - 1]} = {0, 0, • • • , 0} (P3.18.la) 

{*»[0], x,„[l], , x m [N — 1]} 

= [x[m], x [m +1], • • • , x [m + IV - 1]} (P3.18.1b) 

{X m +l[0], X m+ i[l], - - - , X m+1 [N — 1]} 


= {x[m + 1], x[m + 2], • • • , x[m + IV]} 


(P3.18.1c) 
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Thus we can express the N -point DFT X(k, m + 1) of (m + 1)* data segment 
in terms of X(k, m) (i.e., the DFT of the previous segment) as 

X(k, m + 1) = x "' +l[n] W » = El'o 1 x - & + '] W n 

- x m [ n + 1] w%- n+1) w^ k n+ = n W kn W N k 

= (El'o 1 Xm W W " + X[ ^ ] “ X t°]) W N k 

= (X(k, m) + x[N] - X [0]) W~ k (P3.18.2) 

Complete the following program “sig03p_18.m” to check the validity. What is 
the meaning of “discrepancy” in the program? 


%sig03p_18 .m 

% Recursive computation &'£ DFT 
clear, elf 

N=64; n=0:N-l; k=0:N-l; 

Wl=2*pi*8/H; x=sin(Wl*n); 

-5t”fft (x) ; %FFT 

xa=[zeros(1,N) x]; % augment x with N zeros 
Xm=zeros (1,N) ; WN_k=exp (j*2*pi*k/N) ; 
tot m=l:N 

Xm=(Xm+xa(N+m)-xa(m)) .*????; %RDFT 
discrepancy= norm(Xm-X)/norm(X) 

stem (k, abs (Xm) ) ,i./iS|ld bis, pause, stem (k, abs (X) , ' r' ) 
Wjgfcl .’and FFT') 


3.19 Two-Dimensional (2-D) DFT 

Two-dimensional DFT X(k, l) of a 2-D sequence x[m , n ] and its IDFT x[m,n] 
are defined as 

X(k, l ) = Y^~o E,1o * ['"■ w m* w n (P3.19.1a) 

for 0 < k < M - 1 and 0 < / < N - 1 
*[”■•»] = m £« £«*<*•» v M i ~w- w - (P3.i9.ibi 
for 0 < m < M — 1 and 0 < n < N — 1 


The 2-D DFT can be computed by using a MATLAB built-in function f f 12 (). 
On the other hand, the 2-D DFT (P3.19.1a) can be written as two cascaded 
1-D DFTs: 
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X(k, l) = p ( m ’ 0 W M m (P3.19.2a) 

for 0 < k < M — 1 and 0 < / < N — 1 

with P(m, /) = x [m, n] Wft (P3.19.2b) 

for 0 < m < M — 1 and 0 < / < N — 1 

This implies that the 2-D DFT can be computed by taking the 1-D DFT for 
each row of x to get P(m, l) and then taking the 1-D DFT for each column 
of P(m, Z). Noting that the MATLAB function f ft () computes the DFTs of 
each column of the input matrix, compose a program to check the validity of 
Eq. (P3.19.2a-b) for a 2-D rectangular pulse x[m. n] that is produced and 2-D 
or 3-D plotted (in black and white) by the following MATLAB statements: 

»N=64; x=zeros (N,N) ; x(N/2-3:N/2+3,N/2-5:N/2 + 5)=255; 
»mm=[-N/2:W^S-l]; nn= [-N/2 :N/2-l] ; image (nn,mm,x) % .f*© plot 
»mesh (nn, mm, x) , colormap (gray (256) ) ; % Alternatively, 3-D 

In fact, it does not matter whichever of the column and row is taken the DFT 
of first. 

3.20 Short-Time Fourier Transform (STFT) Using Spectrogram 

Let us use the MATLAB function spectrogram() to find the STFT for some 
signals. 
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The fourth octave 



treble clef quarter no(es eighth notes 

E§ 

]—j—j—d— ^ ^—p— p — 

* 

(b) A melody written on the music score 


Fig. P3.20.1 


(a) Referring to the above program “play music wave.m” and the layout of 
a piano keyboard depicted in Fig. P3.20.1(a), use the MATLAB routine 
“music_wave” to produce a sinusoidal wave for a series of musical notes 
shown in Fig. P3.20.1(b) where the frequency for the central note A4 is 
440 Hz and that for any other note is 

/„ = 440 x 2 ( " -49)/12 [Hz] where n is the key number. (P3.20.1) 

(b) Use the MATLAB function “specgram” (in MATLAB of version 6.x) or 
“spectrogram” (in MATLAB of version 7.x) to find the STFT for the 
sinusoidal wave produced in (a). You can change the DFT size from its 
default value N = 256 to 512 and then to 1024 and localize the frequency 
range if you think it to be of help in distinguishing the distinct frequency 
components. Which of the frequency and time resolutions do you gain or 
lose by increasing the DFT size? 

(c) Beyond the current limit of your ability and the scope of this book, you 
can use the RDFT (recursive DFT) or any other technique such as the 
wavelet transform to improve the time and frequency resolution. 

(d) Produce a beat-note signal by summing two sinusoids of slightly different 
frequencies 495 Hz and 505 Hz as 

x{t) = cos(2;r x 495t) + cos(2:r x 505t) 

= 2 cos(27r x 500t)cos(2rr x 5 1) (P3.20.2) 

Determine the FFT size (as a power of 2) such that the two frequencies 
are distinguishable in the spectrogram. How about the DFT size N which 
makes the frequency resolution 


2 505 - 495 

-= -Hz 

NT 2 


(P3.20.3) 
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where the sampling period T is chosen as 0.0001 s? 



Fig. P3.20.2 A beat-note signal 


(cf.) For example, the spectrogram with N = 512 shows a single fre¬ 
quency of around 500 Hz varying in amplitude with time, while 
that with N — 4096 reveals the two different frequencies with 
constant amplitude. 

3.21 Design of DTMF (Dual-Tone Multi-Frequency) Signal Decoder 

DTMF system transmits keys pressed on a keypad (Fig. P3.21(a)) through an 
audio channel such as a telephone line. Every time a key is pressed, it transmits 
two frequencies, each corresponding to the row and column in which the key 
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Coloumn frequencies 

1209Hz 1336Hz 1477Hz 1633Hz 

Row frequencies 

| | | | 

□ 0 0 0 
0 0 0 © 
0 0 0 © 
0 0 0 0 


(a) A DTMF keypad with the row and column frequencies 



Fig. P3.21 

(a) The program “dtmf_generator()” listed below generates a DTMF signal 
(wave) together with the time vector (tt) for given vector (keys) of keys 
pressed and vector (durations) of key pressing duration. A zero period of 
0.1 s is inserted between the key signals so that the decoder can distin¬ 
guish between a single long-pressed key and multiple repeated keys by 
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accepting a new key only after detecting a zero period. Referring to the 
main program “sig03pJ21.m”, make a DTMF signal for the leading three 
digits of your phone number and listen to its sound. 

(b) Figure 3.21(b) shows a Simulink block diagram for a filter bank which 

can be used to detect the DTMF signal. In each bank, sin(cu,T s n) = 
sin(2jr/y7^n) is multiplied with the input signal where f) = 697,770, 852, 
941, 1209, 1336, 1477, and 1633 Hz and the modulated signal is passed 
through a moving or running average filter (MAF). The DTMF signal x 
together with the time vector tt, the sampling period Ts, the analog fre¬ 
quency vector w (co, = 2nfi’s), and the running average filter coefficient 
vector B are supposed to be supplied via the MATLAB workspace. Note 
that the Simulink model file “dtmf.mdl” can be run directly or indirectly 
from a MATLAB program by using the MATLAB command ” as 

illustrated in the program “sig03p 21.m”. Based on the simulation results 
observed through the scope, determine the common threshold value which 
can be used for detecting any one of the eight frequencies from the output 
(<7 ; [n]j of each MAF. 

(c) Complete the following program “dtmf_decoder()” and run it on the 
DTMF signal generated in (a) for demonstration. Note that freq_ 
durations(i) for each frequency is accumulated every sample time the 
corresponding MAF output is larger than the threshold value (Thd) and 
zero.duration is increased by one every time no frequency is detected. 
Whenever the accumulated zero duration exceeds some threshold value 
(Zero.duration) and the frequency durations for at least one of the row fre¬ 
quencies and at least one of the column frequencies exceed some threshold 
(Freq-duration), the key corresponding to the row/column frequencies is 
determined. 
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The z-transform is the discrete-time counterpart of the Laplace transform. It can be 
viewed as a generalization of the DTFT (discrete-time Fourier transform) just as the 
Laplace transform can be viewed as a generalization of the CTFT (continuous-time 
Fourier transform). It plays a vital role in the analysis and design of discrete-time 
linear time-invariant (LTI) systems that are described by difference equations. In 
this chapter we introduce the z-transform and discuss some of its properties and 
applications to LTI system analysis and representations. 
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4 The z-Transfo 


4.1 Definition of the z -Transform 

For a discrete-time sequence x[n], the bilateral (two-sided) and unilateral (one¬ 
sided) z-transforms are defined as 

X [z] = Z [x[n]} = I]“ =oo T[n]z- n I X[z] = Z{x[n]} = J2Zo X[n]z ~" 

(4.1.1a) | " (4.1.1b) 

where z is a complex variable. For convenience, the z-transform relationship will 
sometimes be denoted as 

x[n]^X[z] | x[n]**X[z] 

Note that the unilateral z-transform of x[n\ can be thought of as the bilateral 
z-transform of x[n]u s [n] {u s [n\. the unit step sequence) and therefore the two 
definitions will be identical for causal sequences. The unilateral z-transform is par¬ 
ticularly useful in analyzing causal systems described by linear constant-coefficient 
difference equations with initial conditions. 

The z-transform does not necessarily exist for all values of z in the complex 
plane. For the z-transform to exist, the series in Eq. (4.1.1) must converge. For a 
given sequence x[n], the domain of the z-plane within which the series converges is 
called the region of convergence (ROC) of the z-transform X[z] or X[z]. Thus, the 
specification of the z-transform requires both the algebraic expression in z and its 
region of convergence. 

Note that a sequence x[n] is called 

- a right-sided sequence if x[n] = 0 V n < no for some finite integer n 0 , 

- a causal sequence if x[n] = 0 V n < no for some nonnegative integer no > 0, 

- a left-sided sequence if x[n] = 0 V n > no for some finite integer no, and 

- a anti-causal sequence if x[n] = 0 V n > no for some non-positive integer 

no < 0 , 

respectively. 

Example 4.1 The z-Transform of Exponential Sequences 

(a) For a right-sided and causal sequence x\[n] = a n u s [n], we can use Eq. (4.1.1a) 
to get its bilateral z-transform as 

Xi[z] = Z{xi[n]} = '%2 n= _ oQ a n u s [n]z~ n = X!„ =0 a " z_ " 



This geometric sequence converges for |az 1 < 1, which implies that the ROC 
of Xi[z] is IZi = {z : |z| > \a\] (see Fig. 4.1(a)). 
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lm{z} 



tS 1= {z:|z|>|a|} 


(a) ROC for a right-sided 
sequence 


Im [z] Im {z} 



Xz = {z: |z| < \b\] X = X, n X z = {z: |a| < |z| < \b\} 


(b) ROC for a left-sided 
sequence 


(c) ROC for a both-sided 
sequence 


Fig. 4.1 Three forms of ROC (region of convergence) 


(b) For a left-sided and anti-causal sequence x 2 [n\ = —b n u s [—n — 1], we can use 
Eq. (4.1.1a) to get its bilateral z-transform as 


X 2 [z] = Z{x 2 [n]} = 


= oo —b n u s [—n — l]z“" 
(023) —b~ l Z _ Z 

I — b >z - z-b 


=-z: 


b"z " 

(E4.1.2) 


This geometric sequence converges for |b l z\ < 1, which implies that the ROC 
of X 2 [z] is IZ2 = {z '■ |z| < \b\] (see Fig. 4.1(b)). 

(c) For the both-sided sequence 


y[n] = xi[n] + x 2 [n] = a n u s [n] - b n u s [-n - 1] (E4.1.3) 


we can combine the above results of (a) and (b) to obtain its bilateral z- 
transform as 


Y[z] = Xdz] + X 2 [z] = — + (E4.1.4) 

z—a z-b 

For this series to converge, both of the two series must converge and therefore, 
its ROC is the intersection of the two ROCs TZ\ and 1Z 2 : 1Z = IZi C\ 1Z 2 = 
[z : \a\ < |z| < | b \}. This is an annular region \a\ < |z| < \b\ (Fig. 4.1(c)) if 
\b\ > \a\ and it will be an empty set if \b\ < \a\. 

(cf) This example illustrates that different sequences may have the same z-transform, 
but with different ROCs. This implies that a z-transform expression may 
correspond to different sequences depending on its ROC. 


Remark 4.1 Region of Convergence (ROC) 

(1) The ROC for X[z ] is an annular ring centered at the origin in the z-plane of 
the form 
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r" < \z\ < r+ (4.1.2) 

where r + can be as large as oo (Fig. 4.1(a)) for causal sequences and r~ can be 
as small as zero (Fig. 4.1(b)) for anti-causal sequences. 

(2) As illustrated in Example 4.1, the three different forms of ROC shown in 
Fig. 4.1 can be associated with the corresponding three different classes of 
discrete-time sequences; 0 < r~ < |z| for right-sided sequences, |z| < r + < oo 
for left-sided sequences, and r~ < \z,\ < r + (annular ring) for two-sided 
sequences. 


Example 4.2 A Causal Sequence Having Multiple-Pole z-transform 
For a sum of two causal sequences 

x[n] = Xl [n] + x 2 [n] = 2u s [n] - 2(1/2 ) n u s [n] (E4.2.1) 

we can use Eq. (E4.1.1) to get the z-transform for each sequence and combine the 
z-transforms as 


X[z] = Z [x[n]} = Xi[z] + X 2 [z] (E4 = ' l) 2— 

with a=l and a=l/2 Z~a\ 

2 Z 2z Z 

“ z - 1 z - 1/2 _ (Z - l)(z - 1/2) 

Since both Xi[z] = Z{xi [u]) and X2[z] = Z{x 2 [n]} must exist for this z-transform 
to exist, the ROC is the intersection of the ROCs for the two z-transforms: 

n = n x 0 n 2 = {z : \z\ > 1} n {z : |z| > 1/2} = {z : Iz| > 1} (E4.2.3) 

(cf) Figure 4.2 shows the pole-zero pattern of the z-transform expression (E4.2.2) 
where a pole and a zero are marked with x and o, respectively. Note that the 
ROC of the z-transform X[z] of a right-sided sequence is the exterior of the 
circle which is centered at the origin and passes through the pole farthest from 
the origin in the z-plane. 


— 2 —-— I 

Z~ a | fl=1/2 
(E4.2.2) 



Fig. 4.2 Pole-zero pattern of 
the z-transform (E4.2.2) 
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Before working further with more examples, let us see the relationship between 
the z-transform and DTFT (discrete-time Fourier transform), which is summarized 
in the following remark: 

Remark 4.2 The z-Transform and the DTFT (Discrete-Time Fourier Transform) 
Comparing the bilateral z-transform (4.1.1a) with the DTFT (3.1.1), we can see 
their relationship that the DTFT can be obtained by substituting z = into the 
(bilateral) z-transform: 

Hx[n]} = = X[e* a ] 

= X[z]\ z=eJa = Z{x[n]}\ z=e ja (4.1.3) 

This implies that the evaluation of the z-transform along the unit circle in the z- 
plane yields the DTFT. Therefore, in order for the DTFT to exist, the ROC of the 
z-transform must include the unit circle (see Fig. 4.3). 


Example 4.3 The z-transform of a Complex Exponential Sequence 
Let us consider a causal sequence 

x[n] = e^ in M s [«] = cos(S2in)M s [u] + j sin(£2in)w,[n] (E4.3.1) 

We can find the z-transform of this exponential sequence by substituting a = e jih 
into Eq. (E4.1.1) as 


z(z - e~j Ql ) 

' (z - - e-j Q >)’ 


<j[n] = cos(J2in)u i [n] + j sin(^in)M s [«] 


z z(z — cos J2j) . zsinf^! 
z 2 — 2z cos + 1 "I" J z 2 — 2z cos £2i + 1 
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This implies the following two z-transform pairs: 

(E4.3.2) 

(E4.3.3) 

Example 4.4 The z-transform of an Exponentially Decreasing Sinusoidal Sequence 
For a causal sequence 

x[n] = r n cos(£2mK[«] (D = U '-r n (e ]Q ' n + e~ jn ' n )u s [n] (E4.4.1) 

we can use Eq. (E4.1.1) with a = e ±jQ ' to find the z-transform of this sequence as 

(E44.1) 1 / z z \ _ z(z — r cos £2i) 

2 a=re‘ a 1 and a=re~i a 1 2 \Z — rei a 1 Z — re~l a 1 / Z 2 — 2zX COS + r 2 

(E4.4.2) 


z(z - cosfti) 


z(z - COS^i) 


z 2 — 2z cos ^i + l (z — cos S2i) 2 + sin 2 
with U = {z : |z| > 1} 

: z sin Q| z sin Q | 

z 2 — 2z cos ^i + l (z — cos f2i) 2 + sin 2 
with TZ = {z : |z| > 1} 


where the ROC is TZ = {z : |z| > |r e^'l = |r|}. 

(cf) Note that if | r \ > 1, the ROC does not contain the unit circle and consequently, 
the DTFT does not exist in the strict sense. 

We could elaborate on more examples of the z-transform computation. However, 
we instead list a number of useful z-transform pairs in Table B.9 in Appendix B so 
that the readers can use them for finding the z-transform or inverse z-transform. 

In many cases, we deal with the z-transform that is expressed in the form of a 
rational function, i.e., a ratio of polynomials in z. For such a rational z-transform 
X[z] = Q[z]/P[z], we define its singularities, i.e., poles and zeros as follows: 

Remark 4.3 Poles and Zeros of a Rational z-Transform Expression X[z] = Q[z]/ 

P[z] 

The roots of Q[z] = 0, or the values of z at which X[z] = 0 are called the 
zeros of X[z], The pole s are the roots of P[z] = 0, or the values of z for which 
X[z] = oo. If we count the singularities at z = oo, the number of poles will be 
equal to that of zeros. Notice that, for polynomials with real-valued coefficients, the 
complex-valued singularities must occur in complex-conjugate pairs. 

The ROC of a z-transform X[z] can be described in terms of its poles as follows: 
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Remark 4.4 Pole Locations and Region of Convergence (ROC) 

(1) It is obvious that there can be no poles of a z-transform X[z] inside the ROC 
since the z-transform does not converge at its poles. In fact, the ROC is bounded 
by poles or infinity as illustrated by Examples 4.1 and 4.2. 

(2) For a right-sided sequence x a [n ] and left-sided sequence xi,[n], the ROCs for 
their z-transforms X a [z] and X ; ,[z] are outside/inside the outermost/innermost 
pole, respectively: 

TZ] = {z : |z| > the maximum of |a,|'s}(z = a, : the poles of X a [z]) (4.1.4a) 
(as illustrated by Example 4.2) or 

1Z 2 = {z\ |z| < the minimum of |b,|'s}(z = b, : the poles of X fe [z]) (4.1.4b) 

For a two-sided sequence x[«] = x[ri\ + xtln], the ROC is an annular region 
given by 


1Z = 1Z\ fl 1Z 2 = {z : max \a t \ < |z| < min \bj\} (4.1.4c) 


4.2 Properties of the z-Transform 

In this section we discuss the properties of the z-transform that are useful in obtain¬ 
ing z-transform pairs and in applying the transform to the analysis of discrete-time 
linear time-invariant systems. These properties are very similar to those of the 
Laplace transform and Fourier transform. 

Most of the properties are commonly applicable to the bilateral and unilateral 
z-transforms. There are, however, a few exceptions such as the time shifting prop¬ 
erty, time reversal property, and initial/final value theorems. In particular, it is the 
time shifting property that makes the unilateral z-transform very useful for solving 
difference equations with initial conditions. 


4.2.1 Linearity 

Let the z-transforms of two time sequences x[n] and y\n] be Z{x[n]} = X[z] with 
ROC 1Z X and Z{y[n]} = Y[z] with ROC TZ y . Then we can express the z-transform 
of their linear combination in terms of X[z] and Y[z] as 

ax[n ] + py[n] 4 «X[z] + £Y[z] with ROC 1Z D (1Z\ D 1Z 2 ) (4.2.1) 

where the ROC is generally the intersection of the two ROCs 1Z X and TZ y , but it can 
be larger when any pole of X[z] and Y[z] is cancelled by the zeros resulting from 
the addition. 
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4.2.2 Time Shifting - Real Translation 

Let the bilateral z-transform of x[n] be Z[x[n]} = X[z] with ROC 1Z X . Then the 
bilateral z-transform of a time-shifted version x[n — m] is 

x[n — «i] ** z _ni X[z], ROC TZ X (possibly with z = 0 or oo added or removed) 

(4.2.2) 

The addition/removal of z = oo to/from the ROC occurs when a causal/non-causal 
sequence is shifted to become a non-causal/causal sequence. Similarly, the addi¬ 
tion/removal of the origin z = 0 to/from the ROC is owing to the possible transition 
between anticausal and non-anticausal sequences resulting from the shift operation. 

On the other hand, the time-shifting property of the unilateral z-transform is as 
follows: 

<Case 1 > x[n — m], n\ >0 (delayed sequence) 

Z{x[n - m]} = J2Zo X[n ~ ni]z ~" 

=ni">» -■+El*" -■"'fe- 

""" =“ + ”' E:L, + Xlo 

=#*■ (£>»*-+• 

x[n - n\\ <+z~ ni ^X[z] + x[m]z~ m ^j (4.2.3a) 

where the second term in the RHS will disappear when x[ri] is causal. 
<Case 2> x[n + «i], m > 0 (advanced sequence) 

Z{x[n + m]} = YZo x[n + ni]z ~ H n+ni=m = =m ~ ni YZn, x ^~ (m ~ ni) 

= z " (lT_o* W!r “ - ElE ''■ 

x[n + wi] 4;"' ( X'[-J - X„' =0 (4.2.3b) 

Example 4.5 Applying Linearity and Time Shifting Properties of the z-Transform 
For a rectangular pulse sequence of duration N given by 

x[n] = u s [n ] - u s [n - N ] =*{■”■”0 1° 1 ■ • ’"* 1 0 • • •} 


(E4.5.1) 
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we can use Eq. (E4.1.1) (with a = 1) together with the linearity (4.2.1) and time- 
shifting property (4.2.2) to get its z-transform as 


X[z] 


(E4.1.1)_with a= 1 
(4.2.1)&(4.2.2) 


Z- 1 


Z N ~ 1 

z N ~Kz - 1) 


(E4.5.2) 


Note that X[z] has multiple pole of order N — 1 at z = 0 and N — 1 zeros at 
z = e^ 2mn/N (for m = 1, 2, • • • , N — 1) on the unit circle where the zero at z = 1 
(resulting from the addition) cancels the pole (of Z{u s [n]} = z/(z — 1)) at that point. 
Due to this pole-zero cancellation, the ROC of X[z] becomes |z| >0 (the entire 
z-plane except the origin z = 0), which is larger than that of Z{u s [n]} = z/(z — 1), 
i.e., | z | > 1. 


4.2.3 Frequency Shifting - Complex Translation 

Let the bilateral z-transform of x[n] be Z{x[n]} = X[z] with ROC 7 Z x = {z : 
r~ < |z| < r+). Then we have the z-transform of a frequency-shifted or modulated 
version z"x[n] as 

e jQin x[n] £X[e- J '°'z] with ROC : U x = {z : r~ < |z| < r +} (4.2.4a) 

z^[n]4x|z/z,] with ROC : |zi|ft, = {z : |zi|r“ < |z| < | zi\r+} (4.2.4b) 


4.2.4 Time Reversal 

Let the bilateral z-transform of x[n] be Z\x[n]\ = X[z] with ROC 1Z X = {z : 
r~ < |z| < }. Then we have the bilateral z-transform of a time-reversed version 

x[—ri\ as 

x[-n] ^X[z~ l ] with ROC : \/K x = {z : l/r+ < |z| < 1 /r~} (4.2.5) 

where if z e 7 Z x , then 1/z e 1 /1Z X . 


4.2.5 Real Convolution 

Let the z-transforms of two time sequences g[n] and x[n] be Z{g[n]} = G[z] with 
ROC TZ g and Z{x[n]} = X[z] with ROC 1Z X . Then we can express the z-transform 
of their convolution in terms of <G[z] and X[z] as 


y[n] =g[n]* x[n] Y[z] = G[z] X[z] with ROC TlDOlgn TZ X ) (4.2.6) 
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(proof) 

Z{g[n] * x[n]} (4 '= la) EZ-oo {g[ri\ * x[n])z~" 

°= 9) EZ-oo (EZ-oo g[m]X[n ~ m] ) Z ~" 

= EZ-oo ( g[m] EZ-oc X[n ~ m]z ” ( "” m)z “ m ) 

n - m -, n ^n-, n+m (g[m]z~ m E„ = - 00 x ^ z ~ n ) (4 = a) G[z]X[z] 

This convolution property holds for causal sequences, which implies that the uni¬ 
lateral z-transform also has the same property. It is very useful for describing the 
input-output relationship of a discrete-time LTI system with the input x\ri], out¬ 
put y[n], and impulse response g[n] where the transform of the impulse response, 
Z{g[n]} = G[z], is called the system or transfer function (see Sects. 1.2.3 and 1.2.4). 


4.2.6 Complex Convolution 


Let the z-transforms of x[n] and y\n\ be Z{x[n]j = X[z] with ROC 1Z X = {z : rf < 
|z| < rf) and Z{y[n]} = Y[z] with ROC TZ y — [z : r~ < |z| < r+), respectively. 
Then the z-transform of the product of the two sequences can be expressed in terms 
of X[z] and Y[z] as 


x[n]y[n ] 4 — (f XU/uMuJir'di; with ROC 7 Z={z: 
2 nj J Cl 


x[n]y[n] 4 — <{ XtuMz/ulir^i; with ROC 7^ = {z : 
2 Ttj Jc 2 


<k[< rfr+] 
(4.2.7a) 

< kl < 

(4.2.7b) 


where f c means the complex integral along a closed contour C, within the intersec¬ 
tion of the ROCs of X[z/u] and Y[u] or X[u] and Y[z/t>] (see [0-2], Sect. 2.3.9 for 
its proof). 


4.2.7 Complex Differentiation 

Let the z-transform of x[ri\ be Z{x[n]} = X[z] with ROC 7 Z x . Then the z-transform 
of nx[n] can be expressed in terms of X[z] as 

nx[n] 4 -z ^ X[z] with ROC TZ X 


(4.2.8) 
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This can be proved by differentiating the definition of the z-transform (4.1.1) 
w.r.t. z. 


4.2.8 Partial Differentiation 

If a z-transform pair is given in the form of Z{x(n T, a)} = X(z, a) with a parameter 
a, we can differentiate it w.r.t. a to obtain another z-transform pair as 

^-x(nT,a) +> ^-X(z, a) (4.2.9) 

da da 

Example 4.6 Complex Differentiation and Partial Differentiation 

For y\ri\ = n 2 a"u s [n ], we can apply the complex differentiation property (4.2.8) 
twice for Eq. (E4.1.1) to write 


(z - a) - z _ az 
Z (z - a) 2 (z - a) 2 
a(z - a) 2 - 2az(z - a) 
Z (z- a) 4 


(E4.6.1) 

az(z + a) 

(z - a) 3 
(E4.6.2) 


Alternatively, we can apply the partial differentiation property for Eq. (E4.1.1) to 
get the same results: 


l u,m* 


d_ 

da 




z(z - a) 2 + 2az(z - a) 
(z - a) 4 


z(z + a) 
(z - a) 3 


(E4.6.3) 

(E4.6.4) 


Multiplying both sides of these equations by a yields Eqs. (E4.6.1) and (E4.6.2), 
which are listed in Table B.9(10) and (12). 


4.2.9 Initial Value Theorem 

For a causal sequence x[n] such that x[«] = 0 V n < 0, we can get its initial value 
x[0] from its z-transform as 


x[0]=fimX[z] (4.2.10) 

This can easily be shown by substituting z = oo into the z-transform definition 
(4.1.1b). 



218 


4 The z-Transform 


4.2.10 Final Value Theorem 

For a causal sequence x[n] such that x\n\ = 0 V n < 0, we can get its final value 
x[oo] from its z-transform as 

*[oo] = lim(z - l)X[z] = lim(l - z~ l )X[z] (4.2.11) 

This requires that x[n] should converge or equivalently, all the poles of its z- 
transform X[z] should lie inside the unit circle possibly with the exception of a 
simple pole at z = 1. 

(proof) 

We can use the z-transform definition (4.1.1b) to write 
Z{x[n + 1] - x[n]} = hm (£* =0 *[« + l]z~ n - 

= (T. n i x [ n ]z _(n_1) + x [k + l}z k 
- x[0] -EL x[n]z~ n ) 

On the other hand, from the time shifting property (4.2.3b), we can write 

Z{x[n + 1] - x[n]} (4 = l) Z{x[n + 1]} - Z{x[n]} 

(4 = 3> z(X[z] - x[0]) - X[z] = (z - l)X[z] - z*[0] 

Noting that these two equations are commonly the z-transform of (x[n + 1] — x[n]), 
we can equate their RHSs and substitute z = 1 to get the desired result. 


4.3 The Inverse z-Transform 

In this section we consider how to find x[ri\ for a given z-transform X[z] with its 
ROC. From the complex variable theory, the inverse z-transform formula can be 
derived (see [0-2], Sect. 2.2) as 


x[n\ = (f X[z]z~ n dz (4.3.1) 

2jvj Jc 

where f c means the complex integral along a closed contour C within the ROC 
of X[z] encircling the origin of the z-plane in the counterclockwise direction. It is, 
however, difficult to directly evaluate this integral and therefore we make resort to 
alternative procedures for obtaining the inverse z-transform. 
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4.3.1 Inverse z-Transform by Partial Fraction Expansion 


Noting that the complex variable z appears in the numerator of almost every basic 
z-transform listed in Table B.9, we apply the same procedure as with the inverse 
Laplace transform (Sect. A.4) to get the partial fraction expansion on X\z\/z and 
then multiply both sides by z so that we can directly use the z-transform table to get 
the inverse z-transform. 

More specifically, let X[z]/z be rational as 


X[z] e jMi- b M z M + ... + biz + b 0 3 

z P[z] a N z N + ... + aiz + a 0 

where M and N are the degrees of the numerator and denominator polynomials, 
respectively. If M > N, we divide Q \ [z] by P\z] starting with the highest powers 
of z to produce the remainder polynomial of degree less than N: 


(4.3.3) 


If M < N, we have only the first term on the RHS where c, = 0 for all i. Now, 
for the purpose of illustration, we assume that all the poles of Q[z\/P[z\ are simple 
except one multiple pole of order L at z = p so that we can write Q\z\/P\z\ in the 
following form: 


_ /y' r i \ | r N-L +1 r N K 


, Q[z\ I 


1,2, ...,N -L 


'"- i =T\h | fe - 




, 1 = 0, 1,...,L- 1 


(4.3.4) 


(4.3.5a) 

(4.3.5b) 


Now, substituting Eq. (4.3.4) into Eq. (4.3.3), multiplying the both sides by z, and 
using the z-transform Table B.9, we can obtain the inverse z-transform of X[z] as 


x[n] = | r 'Pi + r N-L+ip n + r N - L+2 np" 1 + ... 

+ r “ (L-l) !( „"U + ■)/ -“ | + +i + 11 (436) 
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Example 4.7 The Inverse z-Transform by Partial Fraction Expansion 

(a) Let us find the inverse z-transform of 

xizi = _£__ z 

z 3 -2z 2 + (5/4)z- 1/4 (z - l)(z - 1/2)2 

with ROC n = {z : |z| > 1} 

We first divide this by z and then expand it into partial fractions: 

X[z] _ r\ r 2 r 3 

z ~ z - 1 z - 1/2 + (z - 1/2)2 
(4.7.3) 4 4 2 


z - 1 z - 1/2 (z - 1/2)2 

where the coefficient of each term can be found from Eq. (4.3.5) a; 




= —, -^ = —4 (E4.7.3b) 

(Z - !) U=i/2 

r 3 <4 =r (z “ l / 2)1 — I = I = -2 (E4.7.3C) 

l ~° Z lz=l/2 z 1 U=l/2 

Now, moving the z (which we have saved) from the LHS back into the RHS 
yields 


z 1 z — 1/2 (z-1/2)2 

Then we can use Table B.9(3), (5), and (10) to write the inverse z-transform a 


] = ( 4 - 4 Q) - 4 n ) u s \n] (E4.7.5) 


where the right-sided sequences are chosen over the left-sided ones since the 
given ROC is not the inside, but the outside of a circle. 

We can use the MATLAB command ‘residue()’ or ‘residuez()’ to get the par¬ 
tial fraction expansion and ‘iztrans()’ to obtain the whole inverse z-transform. 
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It should, however, be noted that ‘iztransO’ might not work properly for high- 
degree rational functions. 

»Nz= [ 0 1]; Dz=poly ( [ 1 1/2 1/2]), [ r, p, k]-residue (Nz, Dz) ; [r p],k %(E4.7.2) 



(b) Let us find the inverse z-transform of 

vr 3 z 


z 2 - (l/4)z - 1/8 (z - l/2)(z + 1/4) 
with one of the following three ROCs: 


: |z| > -z | ,U 2 = \ z : |z| < - f, and 


We first divide this by z and then expand it into partial fractions: 


M = ^_ X[z]= 4^- 

z z — 1/2 z + 1/4 Lzj z — 1/2 


Now, depending on the ROC, we use Table B.9(5) or (6) to write the inverse 
z-transform as follows: 


(i) fti = jz : |z| > : x[n] = 4 u s [n]-4^-^j u s [n\ 

(E4.7.9a) 

(ii) H 2 = jz : |z| < : 

x[n] = -4^j «,[-/»-1] +4^) u s [-n- 1] (E4.7.9b) 

(iii) TZj = [z : l - < |z| < : 

x[n] = -4 0) «,[-«-!]-4 00 u s [n ] (E4.7.9c) 


>>syms z, x=iztrans (3*z/(z , '2-0.25*z-l/8) ) % (E4.7.6) 

x = 4* (1/2)'‘n-4* (-1/4)''n % (E4.7.9a) just a right-sided sequence 
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Example 4.8 The Inverse z-Transform by Partial Fraction Expansion 
Let us find the inverse z-transform of 

Xfz] = 2z ' = __ 

z 2 - z + 1/2 (Z - 0.5 - ;0.5)(z - 0.5 + j 0.5) 

with ROC 11 = {z : |z| > 1} 

We first divide this by z and then expand it into partial fractions: 


Now, moving the z (which we have saved) from the LHS back into the RHS yields 


;e Table B.9(5) to write the inverse z-transform as 

x[n ] = (1 - j)(0.5 + j0.5) n u s [n] + (1 + y')(0.5 - j0.5) n u s [n] 

= s/2 (e~ i7T/4 s/2~ n e jn7r/4 + e j7l/4 s/2~ n e~ jn7l/4 ^ u s [n ] 

= s/l +3 cos((n — 1)—)w s [n] 


As a nice alternative for X[z] having complex conjugate poles like (E4.8.1), we can 
decompose it into the following form, which can be matched exactly with some 
element of the z-transform table: 

= 2z(z - 1/2) 2(1/2)z 

UJ (z - 1/2) 2 + (1/2)2 + (z _ 1/2) 2 + (1/ 2)2 

= 2_ Z(Z ~ rC ° S ^ ) , +2_ ZrSln ^ 1 _(E4.8.5) 

(z — r cos S2[) 2 + r 2 sin 2 (z — r cos £2i) 2 + r 2 sin 2 

where r = 1 /s/2, cos^i = 1 /s/2, sinS2i = 1 /s/2, and = n/ 4. Then we can 

use B.9(18) and (17) to obtain the same result as (E4.8.3): 

x[n\ = 2 (r n cos(^in) + r" sin(^in)) u s [n] 

= 2 (s/2 " cos(^n) + s/2 sin(^n)^ u s [n\ 

= s/2 i+3 cos ((n — 1)— )u s [n] = s/2 +3 sin((n + 1 )—)u s [n] (E4.8.6) 
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(cf) It seems that the MATLAB command ‘iztransO’ does not work properly for 
this problem: 


»syms z, x=iztrans(2*z"2/(z~2-z+l/2)) % (E4.8.1) 

»n=l: 10; xn-2. “ (- (n-3) /2) . *cos ((n-1) *pi/4); stem (n, xnj;^ ftglf on %(E4.8.6) 
>> [r, p, k] =residuez ([2 i|ij i|], [1 -1 1/2]) % Partial fraction expansion 


>>xnl=real(r.'*[p(1).~n; p(2).~n]); stem(n,xnl,'r') % (E4.8.3) alternative 


4.3.2 Inverse z-Transform by Long Division 

Noting that the inverse z-transform can rarely be found in an elegant form like 
Eq. (E4.8.6), we may think of it as an alternative to expand %[z] = Qi\z]/P\z] 
into a polynomial in powers of z _1 and equate each coefficient of z“" to x[n]. More 
specifically, starting with the highest/lowest powers of z depending on the shape of 
the ROC (for a right/left-sided sequence), we divide Qi[z] by P [z] to expand X[z] 
into the power series form of the z-transform definition (4.1.1). For example, let us 
consider X[z] given by Eq. (E4.7.6) in Example 4.7. 

xr 7 i =_^_—_ — _ (4 3 j) 

z 2 - (l/4)z - 1/8 (z - l/2)(z + 1/4) 

(Case 1) If the ROC is given as {z : |z| > 1 /2}, we perform the long division as 

3 z" 1 + (3/4)z~ 2 + (9/16)z~ 3 + • • • 
z 2 - (l/4)z - 1/8) 3z 

3z - 3/4 - (3/8)z~ 1 

3/4 + (3/8)z _1 

3/4 - (3/16)z~‘ - (3/32)z~ 2 

(9/16)z _1 - (3/32)z 2 


Then each coefficient of the quotient polynomial in z "is equated with 
x\n], yielding 


n=0 1 2 3 

x[n] = [ 0 3 3/4 9/16-•• ] : the same as Eq. (E4.7.9a) 

(4.3.8a) 
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(Case 2) If the ROC is given as [z : |z| < 1 /4}, we perform the long division as 

—24z + 48z 2 - 288z 3 + ■ ■ ■ 

- 1/8 - (l/4)z + z 2 j~3z 

3z + 6z 2 - 24z 3 

-6z 2 + 24z 3 
—6z 2 - 12z 3 + 48z 4 
36z 3 - 48z 4 


Then each coefficient of the quotient polynomial in z n is equated with 
x[—n], yielding 

x[n] = [-288 48 -24 V • • • ] : the same as Eq. (E4.7.9b) 

(4.3.8b) 

(Case 3) If the ROC is given as {z : r~ = 1/4 < |z| < r + — 1/2}, X[z] should 
be separated into two parts, one having the poles on or inside the circle 
of radius r~ and the other having the poles on or outside the circle of 
radius r + . Then, after performing the long division as in case 1/2 for the 
former/latter, we add the two quotients and equate each coefficient of the 
resulting polynomial in z ±n with x[=p«], 

4.4 Analysis of LTI Systems Using the z-Transform 

So far we have seen that the z-transform is a general way of describing and 
analyzing discrete-time sequences. Now we will see that the z-transform also 
plays a very important role in the description and analysis of discrete-time linear 
time(shift)-invariant (LTI) systems. This stems from the fact that an LTI system can 
be characterized by the impulse response. Since the impulse response itself is a 
discrete-time signal, its z-transform, referred to as the system or transfer function, 
provides another way to characterize discrete-time LTI systems both in the time 
domain and in the frequency domain. 

Let us consider a discrete-time causal LTI system with the impulse response g[n] 
and input x[n]. Then the output y[n] is the convolution of g[n] and x[n] given by 
Eq. (1.2.9) as 

y[n] = g[n]*x[n] (4.4.1) 

so that, from the convolution property (4.2.6), 


Y[z] = G[z]X[z] 


(4.4.2) 
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where X[z], 7[z], and G[z] are the z-transforms of the input x\n], output y\n], and 
impulse response g[ri], respectively. Note that G[z] is referred to as the system or 
transfer function. 

Remark 4.5 System Function, Pole Location, ROC, Causality, and Stability 

(1) Eqs. (4.4.2) and (3.2.8) have an interpretation of describing the input-output 
relationship of a discrete-time LTI system in the z-domain and in the frequency 
domain, respectively. Comparing these two equations, we can state that the sys¬ 
tem function G[z], evaluated on the unit circle z = e' n , yields the frequency 
response G[e* a ] = G(Q) of the system (Remark 4.2) if G(Q) = !F{g[ri\} 
exists, or equivalently, the ROC of G[z] includes the unit circle. This is anal¬ 
ogous to the continuous-time case where the frequency response G(a>) can be 
obtained by evaluating the system function G(s) on the imaginary axis s = jco. 

(2) Characteristics of a system such as stability and causality can be associated with 
the ROC and pole location of the system function G[z]. For example, if a system 
is causal, its impulse response g[ri\ is a right-sided sequence and therefore, 
the ROC of G[z] M Z{g[n]} must be the outside of the outermost pole (see 
Remark 4.4). If a system is stable, the ROC of G[z] includes the unit circle 
so that the frequency response G[e ,n ] can be defined (see Remark 4.2). If a 
system is both causal and stable, then the ROC of G[z] must include the unit 
circle and be outside the outermost pole. It is implied that for a causal system to 
be stable, all the poles of its system function G[z] must be inside the unit circle 
(Fig. 4.4(a) vs. (b)). 

In particular, for systems characterized by linear constant-coefficient difference 
equations, the z-transform provides a very convenient procedure for obtaining 
the system function, frequency response, or time response. Consider a causal lin¬ 
ear time-invariant (LTI) system (in Fig. 4.5) whose input-output relationship is 
described by the following difference equation 

£ ( =0 «<y[»-||-£ J=0 bjX[n-n (4.4.3) 


Re{z} 


(a) All poles inside the unit circle (b) Not all poles inside the unit circle 

Fig. 4.4 Pole locations, ROC, unit circle, causality, and stability 
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Input _ Output 


x[n] 

Impulse response g[n] 

X^ 0 _1 a,y[n-i] = bjx[n-j] 

y[n] = g[n]*x[n] 

z-Transform of input 

A[z] Y[z] = B[z]X[z] 

z-Transorm of output 

X[z] 

System or transfer function G[z] 

X[zj A[z\ 

Y[z] = G[z]X[z] 

X[Q] 

Frequency response G(£2) = 

Y(Q) = G(Q.)X( Cl) 

Input spectrum 

X(£l) A(Cl) 

Output spectrum 


Fig. 4.5 The input-output relationship, system function, and frequency response of a discrete-time 
LTI system 


where the initial conditions are given as y[no], y[no — 1], ■ ■ • , y[riQ — N A + 2], 
This can be solved iteratively for the time response y[n] to an input x[ii\ starting 
fromu = no + 1: 

y[n\ = — i~aiy[n - 1]- a NA -iy[n -NA + 1] + z2 j=0 bjX ^ n ~ ) 

(4.4.4) 

With zero initial conditions and the unit impulse input x[n\ = 5[n], this yields 
the impulse response y[n] = g\n\. To find the system function as the z-domain 
input-output relationship, we assume zero initial conditions and use the linearity 
and time-shifting properties to take the z-transform of Eq. (4.4.3) as 

^17' fl '^ 7[z] = Ej=o _1 b J z ~ Jx ^ A ^ Y lz] = B[z]X[zV, 

Y\z\ B\z\ x— S N A—\ x— \NB—l 

G[z] = — = — with A[ Z ] = J2 i=0 ' and B W = J2 j=0 b J z 1 

(4.4.5) 

This is referred to as the system function. Substituting z = into the system 
function or taking the DTFT of the impulse response g[n], we can obtain the fre¬ 
quency response of the system. Figure 4.6 shows the overall relationship among 
the time-domain relationship (in the form of difference equation), the system (or 
transfer) function, the impulse response, and the frequency response. 


lFVa;y[n-i]=l" B ;\x[n-j] /-' ransTOfm » A[z]Y[z] = B[z]X[z] 
| Inverse z-transform j | 

z-Transform^ _ Y[z] _ B[z] 


— Frequency domain 


DTFT (discrete-time Fourier transform) 


Fig. 4.6 The relationship between the impulse response, system function, and frequency response 
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Especially when we are interested only in right-sided sequences and causal lin¬ 
ear systems, it is sensible to use the unilateral z-transform instead of the bilateral 
Z-transform. It is the time shifting property that makes the unilateral z-transform 
particularly useful in analyzing causal systems described by difference equations 
with initial conditions. 

Example 4.9 Difference Equation, System Function, and Impulse Response 

Consider a discrete-time causal LTI (linear time-invariant) system whose input- 
output relationship is described by the following difference equation: 


1 


1 


y[n] - -y[n - 1] - -y[n - 2] = x[n - 1] 


(E4.9.1) 


(a) Find the system function G[z]. 

Applying the linearity and time-shifting properties of the z-transform or using 
Eq. (4.4.5), we can obtain the system function as 


(b) Find the impulse response g[n]. 

Noting that the system is causal and accordingly, the ROC of G[z] is z > 1/2 
(the outside of the circle passing through the outermost pole), we obtain the 
inverse z-transform of G[z] as 


gW = ir 1 j 


1 partial fraction ex 


(z - l/2)(z + 1/4) J 


Alternatively, the impulse response can be obtained directly from the dif¬ 
ference equation, which can be solved iteratively with the unit impulse input 
x[n] = S[n] and zero initial conditions: 

y[n] = l -y[n - 1] + l -y[n - 2] + x[n - 1] (E4.9.4) 

where y[— 1] = y[—2] = 0 and x[n — 1] = S[n — 1] = 1 only for n — 1. 


n = 0 : y[0] = (l/4)y[-l] + (l/8)y[—2] + x[-l] = 0 - 0 + 0 = 0 

n = 1 : y[l] = (l/4)y[0] + (l/8)y[-l] + x[0] = 0 - 0 + 1 = 1 

n = 2 : y[2] = (l/4)y[l] + (l/8)y[0] + x[l] = 1/4 - 0 + 0 = 1/4 

n = 3 : y[3] = (l/4)y[2] + (l/8)y[l] + x[2] = 1/16 + 1/8 + 0 = 3/16 
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The objective of the above program “sig04e09.m” is as follows: 

- Find the impulse response g[ri\ in two ways, that is, by taking the inverse z- 
transform of the system function G[z] and by solving the difference equation for 
the output y[n] to the impulse input x[n\ = S[n], The MATLAB built-in function 
‘filter () ’ together with ‘f iltic () ’ (Sect. E.12) can also be used to obtain 
the output to any input and any initial condition. Also check if the two results 
conform to each other. 

- Find the frequency response G(£2) in two ways, that is, by taking the DTFT of 
the impulse response g[n] and by substituting z = e' Q into the system function 
G[z] = B[z]/A[z], where the latter job is done by using the MATLAB built-in 
function ‘freqz () ’. 

(cf) Comparing Eq. (E4.9.2) with Eq. (E4.9.3), we can tell that the poles of the 
system function, say, p\ = 1/2 and p? — —1/4 yield the modes of the sys¬ 
tem, each of which determines how the corresponding output term evolves with 
time. See the stability theorem A.l. 

Remark 4.6 Computational Method for Inverse z-Transform 

Example 4.9 suggests another way of obtaining the inverse z-transform. That 
is, we can regard a rational z-transform expression G[z] as a system function and 
set it equal to T[z]/ X[z]. Then, cross multiplying yields the z-domain input-output 
relationship 
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W] = G[z] = Wi’ A[z]Y[z] = B[z]x[z] (4A6) 

with A[z] = Xifeo” 1 a iZ~ l and B[z\ = X!7=o _1 bjZ~ j ■ We can write the correspond¬ 
ing difference equation 

t— \NA—l x — yNB—l 

J2i- 0 «,>'[« -i] = Y.J-0 - n (4.4.7) 

and solve it iteratively with x[n] = <5[n] and zero initial conditions for y[n] in the 
forward/backward direction to get a right/left-sided sequence g[ri\ = Z~ l {G[z\). 
Just as with the long division method, this gives us no analytical solution in a closed 
form. Note the following fact: 

Ylzl lz W =i = G[z]X[zi\ xlz]=l = G[z J 

y[n ]!,[„]=,[„] = Z~ l {G[z]} = g[n] (4.4.8) 

So far, we have never felt the necessity of the unilateral z-transform over the 
bilateral one. Now, we are about to look at an initial value problem for which the 
unilateral transform is indispensable. 

Example 4.10 Different Difference Equations Describing the Same System 

(a) Find the output yi [n] of the causal system whose input-output relationship is 
described by 

yi[n] - a yi[n - 1] = x x [n - 1], n > 0 (E4.10.1) 

where yi[—1] = yo and 

xi[n] = b n u s [n] with b ± a (E4.10.2) 

(Solution) 

To solve this difference equation for yi[n], we apply the time shifting property 
(4.2.3a) for Eq. (E4.10.1) to write its z-transform as 

YiM ~ aiz-'Ydz] + yil-l 1) = z~ l Xdz] + jc x [—1]; 

(1 - az-'Wdz] =ay 0 + z ] X t M (E4.10.3) 

(E4.10.2) 

since xi[—l] = b n u s [n]\ n= _ 1 = 0. We can solve this algebraic equation 
for Y\ [z] as 

Y\[z\ = - ---f (a yo+z~ l X\[z\) = — (a yo + z _1 —(E4.10.4) 

1 -ar 1 z-a \ z-bj 
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To take the inverse z-transform of this expression, we divide its both sides by 
z and perform the partial fraction expansion as 



Now we take the inverse z-transform to get the output as 

n 1 

yi[n]. ay 0 a u s [n] -\ - -(a - b )u s [n] 

a — b 

= y 0 a n+1 u s [n + 1] H- —r(a n - b n )u s [n ] (E4.10.6) 

a — b 

Here, we replaced u s [n] by u s [n + 1] to express the existence of the given initial 
condition yi[-l] = >’ 0 . 

(b) Find the output y 2 [n] of the causal system whose input-output relationship is 
described by 

y 2 [n + 1] - ay 2 [n ] = x 2 [n], n > 0 (E4.10.7) 

where y2[0] = yo and 

x 2 [n] = xi\n - 1] = b n ~ l u s [n - 1] with b ± a (E4.10.8) 

(Solution) 

To solve this difference equation for y 2 [n], we apply the time shifting property 
(4.2.3b,a) for Eq. (E4.10.7) to write its z-transform as 

z(T 2 [z]-y 2 [0])-aT 2 [z] = X 2 [z]; 

(z - a)Y 2 [z\ = zy 0 + X 2 [z ] = zy 0 + z“%[z] (E4.10.9) 

since x\[— 1] (E4 =°'“ ) b"u s [n]\ n= _ t = 0. We can solve this algebraic equation 
for Y 2 [z\ as 

Y 2 [z] = — (zy 0 + z~ l X l [z]) = ^(E4.10.10) 

z-a z-a (z - a)(z - b ) 


To take the inverse z-transform of this expression, we divide its both sides by 
z and perform the partial fraction expansion as 



4.5 Geometric Evaluation of the z-Transform 

y 2 [z] yo | l 

z z-a z(z — a)(z - b ) 

y 0 1 lab \/a(a — b) \/b(b-a) 

z-a + z + z-a + z-b 

Y 2 \z] = \ - r— ~z) 

z-a ab a — b \a z — a bz-bj 

Now we take the inverse z-transform to get the output as 

1 1 

yi[n ] = yo a u s [n ] + —<5[n] - -(a - b )u s \n ] 

ab a — b 

= y 0 a n u s [n ] + —’—(a"" 1 - b n ~ 1 )u s [n - 1] (E4.10.12) 

a—b 

Here, u s [n] is replaced by u s \n — 1] to show that the 2 nd and 3 rd terms cancel 
each other at n = 0. 

(cf) Comparing Eqs. (E4.10.6) and (E4.10.12), we see that y\ [n — 1] = yi[n]. Thi s 
can be verified by showing that 

Z{ydn - 1]} = Y 2 [z] = Z{y 2 [n]} (E4.10.13) 
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(E4.10.ll) 


(Proof) 

Z{yi\n - i]} (4 ^ 3a) z-t (7| [z] + V|| _ l k) = g '(T,[zi + yoz) 

( 4 .=. 4 ) z_i(—*—(zayo + X^z^ + yoz) = —— (z y 0 + z _ 1 ^i[z]) (41 = 10) ^[z] 

z -a z-a 

(E4.10.14) 

The justification is as follows: The two LTI systems of (a) and (b) are inherently 
the same. Compared with (a), the initial conditions and input of (b) are delayed by 
n i = l and consequently, the output of the system (b) is also delayed by n\ = 1. 


4.5 Geometric Evaluation of the z-Transform 

In this section we discuss a geometrical method to evaluate a rational function in z 
at any point in the z-plane, particularly on the unit circle z = e' a for obtaining the 
frequency response G(Q) from the pole-zero plot of the system function G[z]. 

Let us consider a system function G[z] given in a rational form as 

G[ z ] = _ K fe ~ ziXz ~ zi) ■ ■ • (z - zm ) 

Z Ilili (z - Pi) (z - PiXz - Pi) • • • (z - Pn) 


(4.5.1) 
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where zf s and pd s are finite zeros and poles of G[z], respectively. The value of 
G[z] at some point 7 = 7 0 in the z-plane is a complex number that can be expressed 
in the polar form as 


G[z 0 ] = |G[z 0 ]|ZG[z 0 ] (4.5.2) 


where 


Magnitude : |G[z 0 ]| = |K| 1 —— (4.5.3a) 

Ui=i\zo-Pi\ 

Phase : ZG[z 0 ] = Y^ =l Z(z ° _ ~ Y^ =1 Z(z ° _ P')( ±7r ) 

with ± n only for K <0 (4.5.3b) 

(z0 — z ; )’s and (zo — p,-)’s in the above equations are complex numbers, each of 
which can be represented by a vector in the z-plane from Zj or p, to zo- They can 
be easily constructed from the pole/zero plot where |zo — z, and |zo — p, are the 
distances, while Zzo — Zj and Zzo — p, are the phase angles. 

As mentioned in Remark 4.5(1), the frequency response G(Q) can be obtained 
by evaluating the system function G[z] on the unit circle if it exists. Keeping this in 
mind, we can use the pole-zero plot to get the approximate shape of the magnitude 
response |G(£2)| without computing the frequency response from Eq. (4.5.2). Here 
is the overall feature of frequency response related with the pole-zero pattern: 

Remark 4.7 Frequency (Magnitude/Phase) Response and Pole-Zero Pattern 

(1) For a pole/zero near the unit circle, the magnitude response curve tends to have 
a sharp peak/valley and the phase changes rapidly by about 180° at the corre¬ 
sponding frequency. As the pole/zero moves to the unit circle, the peak/valley 
becomes sharper. On the other hand, as the pole/zero moves to the origin, the 
peak/valley becomes smoother. Such a tendency can be observed from Fig. 3.2 
where the frequency responses of G[z] = z/(z— a) are depicted for a = 0.8 and 
0.5. Also, the phase jump of n [rad] occurring at the frequency corresponding 
to a zero on the unit circle is illustrated by Figs. 3.1, 3.7, 3.11, and 4.8. 

(2) Generally speaking, if a singularity (pole/zero) is located close to the unit circle, 
it will dominate the frequency response in the frequency range adjacent to that 
location. This idea of dominant singularity is helpful not only for getting an 
approximate frequency response, but also for the pole/zero placement design 
to achieve a desired frequency response. For example, the magnitude response 
(Fig. 4.7(b)) of the system described by (E4.11.1) has the maximum around 
Q = ±7r/4 due to the pole at z = 0.5\/2e ± - ,7r/4 and becomes zero at £2 = n 
because of the zero at z = — 1. In contrast, the zero at z = 0 (which is far from 
the unit circle) has no influence on the magnitude response. 
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Example 4.11 Pole-Zero Pattern and Frequency Response 
For the system function 

G r l = z(z + 1} __ + l) _ 

U z 2 -z + 0.5 (z - 0.5 - j0.5)(z - 0.5 + j 0.5) 


(E4.11.1) 


we have the pole-zero plot and the frequency response magnitude and phase curves 
depicted in Fig. 4.7(a), (b), and (c), respectively. As shown in Fig. 4.7(b), the mag¬ 
nitude of G(£2) = G[e ,n ] becomes zero at Q. — it corresponding to the zero 
z = —1, i.e., 


\G[e^]\\ n=n = |G(«]|| Z _! = 0 (E4.11.2) 



(b) The magnitude curve of the frequency response G(T2) = G [ e i'- 1 ] 



(c) The phase curve of the frequency response G(£2) = G[e J °] 


Fig. 4.7 The pole-zero plot and frequency response for Example 4.11 
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and it reaches the peak around £2 = ±7 t/ 4 adjacent to the phases of the poles 

z = 0.5 ± y'0.5 = 0.5s/2e ±j * /4 (E4.11.3) 


(a) Let us hnd the response of the system G[z] to a sinusoidal input x\ [n] = 
sin(£2 p n) with £2 p = 0.68. 


Yi[z] = Xdz]G[z]=- 


(. z — cos £2 p ) 2 + sin 2 £2 p (z — 0.5) 2 + 0.5 2 
—3.60 x z,(z — cos £2 P ) + 3.89 x z sin £2 P 
{z — cos £2 p ) 2 + sin 2 £2 p 
3.60 x z(z — R cos £2 S ) — 1.65 x zR sin £2 S | 

+ (z - R cos £2 S .) 2 + (R sin £2,) 2 L=^ ( n, = = 

yi[ri] = Z~ l {^[z]} = —3.6cos(£2 p n) + 3.89 sin(£2 p n) 

+ V2 (3.6cos(n;r/4) — 1.65 sin(n;r/4)) 


= (5.3 sin(£2 p n - 0.7457) + V2 ”(3.6cos(w;r/4) 

— 1.65sin(n^/4)))w s [n] (E4.11.5) 


Note that the sinusoidal steady-state response y ljSS [n] = 5.3 sin(£2 p « — 0.7457) 
has the same frequency with the input x\[ri\, hut its amplitude is |G(£2 P )| = 5.3 
times that of the input and its phase is ZG(£2 P ) = —0.7457 ~ — 1.1 £2 ; , plus 
that of the input, as can be seen from Fig. 4.8(a). 

(b) Let us find the response of the system G[z] to a unit step (DC) input X2M = 
u,sln]. 


? ? : Input * * j 


Tip* i j j I 


T : Output 

,3 [ 

(a) The output of the system of Example 4.11 to a sinusoidal input sin (£2 pn ) 


nininin 


(b) The output of the system of Example 4.11 to a unit step (DC) input 


Fig. 4.8 The output of the system of Example 4.11 to sinusoidal/DC inputs 












Thus the response to x 2 [n] — u s [ri\ can be obtained from the inverse z- 
transform as 

y 2 [n\ = Z~ x {T 2 [z]} = (4 + V 2 "(-3 cos(n7r/4) + sin(n^/4))^ u s [n\ 

(E4.11.7) 

Note that the DC steady-state response y2,ssM = 4 is the DC gain |G(0)| = 4 
times that of the input, as can be seen from Fig. 4.8(b). 


In fact, the inverse z-transform of Y\\z] as well as Figs. 4.7 and 4.8 is obtained 
by running the following MATLAB program “sig04el l.m”, where we managed to 
get the coefficients of the partial fraction expansion using residue() since iztrans() 
does not work properly for this case. 



B=[1 1 0]; A=[1 -1 0.5]; %numerator/denominator of system function (E4.11.1) 
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4.6 The z-Transform of Symmetric Sequences 

In this section we explore some features of the phase characteristic and pole-zero 
pattern for systems having (anti-)symmetric impulse responses of finite duration. 

4.6.1 Symmetric Sequences 

Let us consider a symmetric sequence g[n] of duration N + 1 such that 

g[n] = g[N — re] for n = 0 : N (4.6.1) 

<Case 1> If N is even, i.e., N = 2 M for some integer M, then the z-transform of 
g[n] is 





4.6 The .—Transform of Symmetric Sequences 


237 


G[z] = EL' 8[n]z ~" + + E„1m+i 8[n]z ~ n 

(4=D E^IqI + 2 _<iV_ " ) ) + gMz"" 

= z ( g[M] + E„ =0 sW(z n+ + z” ) J With M = — 

(4.6.2a) 

which, with z = e ,n , yields the frequency response as 

G(tt) = (g[|] + E ,^” 1 W cos - n) Z - 

(4.6.2b) 

<Case 2> If IV is odd, i.e., N = 2 M — 1 for some integer M, then the z-transform 
of g[n] is 

G[z] = E„to' 8[n]z ~" + E1m ^ [n]z_ " 

= E „ =0 + z " _Ar ) 

M^V+P/2^ ^ [n](z -n + iV/2 + z n~N,2 ); (4 63a) 

which, with z = e ,n , yields the frequency response as 

^(jv-d/2 ((N \ \ N 

G(ft) = E n _ 0 2g[n] cos ( ( —— nJ£lJZ——£l (4.6.3b) 

Note that G[z| , = G[e^]|^ =jr = 0. 

4.6.2 Anti-Symmetric Sequences 

Let us consider an anti-symmetric sequence g[n] of duration N + 1 such that 

g[n ] = — g[N — n] for n — 0 : N (4.6.4) 

<Case 1> If N is even, i.e., N = 2M for some integer M, then we have g\M] = 
—g[Af], which implies g[M] = 0. The z-transform of g[n] is 


G[z] = Z~ M E „ =0 S[n]{z~ n+M - z n ~ M ) with M = - (4.6.5a) 
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which, with z = e' Q , yields the frequency response as 

^N/ 2—1 ((N \ \ N 7t 

G ^ = E, i=0 2g[n]sin((--nj£2jZ--£2 + - (4.6.5b) 

Note that G[e^]| fi=0 = 0 and G[e ,Q ]\ n=7l = 0. 

<Case 2> If N is odd, i.e., N = 2M — 1 for some integer M, then the z-transform 
of g[n\ is 


G[z] = z~ N/2 gW(z~ n+N/2 - z n ~ N/2 ) (4.6.6a) 

which, with z — e jQ , yields the frequency response as 

1)/2 ((N \ \ N n 

G(fi) = J2 n=0 2 SM sin M - - n\ Z - -Q + - (4.6.6b) 

Note that G[^ n ]| n () = 0. 

Remark 4.8 Pole-Zero Pattern and Linear Phase of (Anti-)Symmetric Sequences 

(1) From Eqs. (4.6.2a)/(4.6.5a) and (4.6.3a)/(4.6.6a), we can see that if G[zo] = 0, 
then G[zq'] = 0, which implies that real zeros occur in reciprocal pairs (zo 
and Zq 1 ) and complex zeros occur in reciprocal, complex-conjugate quadruplets 
(z 0 = r 0 Z ± S2 0 and Zq 1 = r^'Z ± Q 0 ). Note that zeros on the unit circle form 
their own reciprocal pairs and real zeros on the unit circle, i.e„ z = 1 or z = — 1, 
form their own reciprocal, complex conjugate pairs. Note also that all the poles 
are located at z = 0 or oo. See Fig. 4.9(al) and (a2). 

(2) From Eqs. (4.6.2b)/(4.6.5b) and (4.6.3b)/(4.6.6b), we can see that they have 
linear phase, i.e., their phases are (piecewise) linear in £2 except for phase jumps 
of ±7r or ±2 7i (see Remark 3.3 and Fig. 4.9(d) and (c2)). 

(3) If a system has the impulse response represented by a symmetric or anti¬ 
symmetric sequence of finite duration, such a system has linear phase shifting 
property so that it will reproduce the input signals falling in the passband with a 
delay equal to the slope of the phase curve. That is why such a system is called 
the linear phase FIR filter. 

Example 4.12 Pole-zero Pattern of Symmetric or Anti-symmetric Sequences 

(a) Consider a system whose impulse response is 

gl [n] = [..."o” 1 1-2.5 5.25 -2.5 L0 ()•••]. (E4.12.1) 

This system has the system function Gi[z] = Z{g\[n]} as 
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(al) The pole-zero plot for G-, [z] (a2) The pole-zero plot for G 2 [z] 




(cl) The phase curve ZG 1 [e- ,fl ] (c2) The phase curve ZG 2 [e jn ] 


Fig. 4.9 The pole-zero plots and frequency responses for Example 4.12 

Gi[z] = 1 - 2.5z -1 + 5.25z -2 - 2.5z“ 3 + z“ 4 

= z~ 4 (z - 0.5 e j7t/3 )(z - 0.5 e~ in/3 )(z - 2 e jn/3 )(z - 2e~ j7l/3 ) 

(E4.12.2) 

whose pole-zero pattern and frequency response magnitude/phase curves are 
plotted in Fig. 4.9(al) and (bl)/(cl), respectively. 

(b) Consider a system whose impulse response is 

g2 [n] = [■■■ "o” 1 -1 2-210-]. (E4.12.3) 

This system has the system function G 2 [z] = Z{g 2 [n]} as 

G 2 [z] = -1 + 2z _1 - 2z“ 2 + z“ 3 = -z“ 3 (z - l)(z 2 - z + 1) 

= -z" 3 (z - 1)(Z - e yjr/3 )(z - e~ jx/3 ) 


(E4.12.4) 
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whose pole-zero pattern and frequency response magnitude/phase curves are 
plotted in Fig. 4.9(a2) and (b2)/(c2), respectively. 


The following program “sig04el2.m” is run to yield Fig. 4.9, where zplane(B,A) 
is used to create the pole-zero plot of a system with system function G[z] — 
B[z]/A[zl 


%sig04el2.m 
clear, elf 

N=360; W=pi/N*[-N:N]; % frequency range 
for i=l:2 

if i==l, B=[1 -2.5 5.25 -2.5 1]; A=l; 
else B=[-1 2 -2 1]; A=l; %numerator/denominator oi 

: system function 

end 

figure(1), subplot (220+i), zplane(B,A) 

GW= freqz(B,A,W); % frequency response 

GW_mag= abs(GW); % magnitude of frequency response 
GW_phase= angle(GW); % phase of frequency response 
figure(2) 

subplot(220+i), plot(W,GW_mag) 

set(gca,'fontsize',9, 'Xlim',[-pi pi], 'xtick',[-pi 

0 pi], ... 

'xticklabel',{'-pi' '0' 'pi'}) 
subplot (222+i), plot (W, GW_phase) 

set(gca,'fontsize',9, 'Xlim',[-pi pi], 'xtick',[-pi 

0 pi], ... 

'xticklabel',{'-pi' '0' 'pi'}) 



4.7 Summary 

In this chapter we have defined the bilateral/unilateral z-transform and derived their 
basic properties. We have also presented the several methods to find the inverse 
z-transform of a given z-transform expression. We have explored the relation¬ 
ship among the system function, frequency response, and difference equation and 
discussed how to utilize the z-transform for analyzing discrete-time LTI systems. 

Problems 

4.1 z-Transform 

(a) Find the bilateral z-transform X[z] (with its ROC) of 

x[n] — a 1 " 1 = a n u s [n\ + a~ n u s [-n - 1] with \a\ < 1 (P4.1.1) 

(b) Could you get the bilateral z-transform of 

x[n] = 1 = u s [n] + u s [—n - 1] (P4.1.2) 

If your answer is yes, find it. Otherwise, state why it is not possible. 
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(c) Find the bilateral z-transform X[z] (with its ROC) of 


x[n] = u,[~n ] 


(P4.1.3) 


in the following three ways: 

(i) Noting that u s [—n] is the one-sample delayed version of u s \—n — 1], 
use the time shifting property. 

(ii) Noting that u s \—n] is the time-reversal version of u s [ri], use the time 
reversal property. 

(iii) Noting that u s [—n] can be expressed as u s \—n — 1] + S[n], use B.9(6) 

&d). 

4.2 Inverse z-Transform 

(a) Find the inverse z-transform x[n] of 


with ROC TZ = [z : |z| > 1} 


z z 

||| X r 


(P4.2.1) 


in the following two different ways: 

(i) Use the z-transform table B.9(10) and the time shifting property 
4.2.3(b) or B.7(2). 

(ii) Use the z-transform table B.9(5) and the convolution property 4.2.6 
or B.7(4). 

(b) Use the z-transform table B.9(17) and the time shifting property 4.2.3(a) or 
B.7(2) to find the inverse z-transform of 

X[z] = , a , = z" 1 x with ROC 7?. = {z : |z| > a] (P4.2.2) 

z 2 + a 2 z 2 + a 2 

(c) Find the inverse z-transform x[n] of 


(z - l)(z 2 - z + 1) 

(d) Find the inverse z-transform x[n] of 


with ROC Tl = {z:\z\> 1} (P4.2.3) 


(z - 1) 2 Z 2 (z - l) 2 
with ROC 'll = {z : |z| > 1} 


4.3 Inverse z-Transform, Causahty, Convergence, and Stability 

(a) Find the inverse z-transforms g a i [n], g a 2[n], and g a i\n\ of 

3d -z- 1 ) _ 3z(z — 1) 

1 - (5/2)z-> + z- 2 (z - 2)(z - 1/2) 


(P4.3.1) 
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with one of the following ROCs: 

(i) TZi = {z : [z| > 2}, (ii) H 2 = {z : [z| < 1/2}, and (iii) 1l 3 = [z : 
1/2 < |z| < 2}. Then determine the causality and convergence (to 
zero) for each of g;[n]’s. 

(b) Find the inverse z-transforms gb\ [n], gwM. and gi,3[n] of 


G„[z ] = 


2z(z + 1) 
z 2 + (3/4)z +1/8 


2z(z + 1) 

(z + l/4)(z + 1/2) 


(P4.3.2) 


with one of the following ROCs: (i) = [z : |z| > 1/2}, (ii) U 2 = [z : 

|z| < 1/4}, and (iii) IZ3 = [z, : 1/4 < |z| < 1/2}. Then determine the 
causality and convergence (to zero) for each of g;[n]’s. 

(c) Suppose G a [z\ and G*[z] are the system functions of discrete-time sys¬ 
tems. Then the causality and stability of the systems depends on the 
causality and geometric convergence (to zero) of the impulse response 
g;[n]’s. Referring to the stability criterion that the ROC should contain the 
unit circle (Remark 4.5(2)), determine the stability of the above six cases. 
For each case, plot the impulse response for n = —20 : 20 and complete 
the following table: 

(d) What do you think about the stability of a system having a pole on the unit 
circle, which is the boundary between the stability and instability regions? 
Let us consider a system with the system function 

G c [z] = —^ with ROC H = [z : |z| > 1} (P4.3.3) 

z - 1 

Suppose a bounded input such as the unit step sequence x[n] = u s [n] is 
applied to this system and find the output. Is it bounded? Is the system 
(BIBO) stable? Can you find any (bounded) input such as a sine-wave 
which makes the output of the system blow up? 

(cf) If a discrete-time LTI system has all its poles inside or on the unit circle 
and the poles on the unit circle are simple (distinct), the system is said to 
be marginally stable. Likewise, if a continuous-time LTI system has all its 
poles inside the LHP (left-half s -plane) or on the 7 co-axis and the poles 


Table P4.3 Pole location, ROC, causality, and stability of a system 
All poles inside the unit circle The unit circle inside ROC Causality Stablility 

(a>-(i) 

(a)-(ii) 

(a) -(iii) 

(b) -(i) 

(b)-(ii) 

(b)-(iii) _ 
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on the jco-axis are simple (distinct), the system is said to be marginally 
stable. 

4.4 To Solve Difference Equation Using the z-Transform 

Consider the following difference quation 

y[n] - ^y[n - 1] = x[n] with x[n ] = 2 ~ n u s [n] (P4.4.1) 

(a) Solve it with the initial condition y[—1] = —3. 

(b) Solve it with the initial condition y[—1] = 6. 

(cf) This problem implies that the output of an LTI system has generally the 
system mode (in the natural response) and the input mode (in the forced 
response), but the system mode may disappear depending on the initial 
conditions. 

4.5 Forward/Backward Solution of Difference Equation by Iteration 

Consider the following difference quation: 

y[n] - ^ y[n - 1] - ^y[n - 2] = 3 x[n - 1] with x[n ] = <5[n] (P4.5.1) 

(a) Solve it forward with no initial condition (y[—2] = y[— 1] = 0) to find 
y[n] for n = 0 : 3. To do this, you should rewrite the difference equation as 

y[n\ = l -y[n - 1] + X -y[n - 2] + 3 x[n - 1] with x[n] = S[n ] (P4.5.2) 

(b) Solve it backward with no initial condition (y[l] = y[2] = 0) to find y[n] 
for n = — 3 : 0. To do this, you should rewrite the difference equation as 

y[n - 2] = —2 y[n - 1] + 8y[n] - 24x[n - 1] with x[n] = S[n] (P4.5.3) 


(cf) You can use the following program “sig04p_05.m”. Do the results agree 
with the solutions (4.3.8a,b) obtained using the long division in Sec. 4.3.2 
or (E4.7.9a,b)? 
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yb(10)=0; yb(ll)=0; % zero initial conditions 
xb= zeros (1,10); xb(9)=l; % unit- iatptiise Mf*w6' 
for n=ll:-1:3 

yb (n-2) = -2*yb(n-l) + 8*yb(n) -24*xb(n-l); 
yb 

nn 3:0; ybl= -4* (1/2) . ~nn + 4* (-1/4) . *nn|- 
[yb(1:end-2); ybl] 


4.6 Difference Equation, System Function, Impulse Response, and Frequency 

Response 

Consider a causal system whose input-output relationship is described by the 

following difference quation: 

y[n ] - y[n - 1] + 0.5y[n - 2] = x[n] + x[n - 1] with y[-2] = y[-l] = 0 

(P4.6.1) 

(a) Find the system function G[z] = F[z]/X[z] and determine the stabihty 
based on its pole locations. 

(b) Find the frequency response G(Q) = G[e' n ] at £2 = 0, n/2, and it or 
e’ n = 1,7, and —1 where G(0) = G[e J0 = 1] is referred to as the DC 
(direct current) gain. 

(c) Find the impulse response g[n], i.e., the output of the system to the unit 
impulse input x\n ] = 8 [n] in two ways; once using the z-transform and 
once using the iterative method for n =0:4. Does the DTFT of [g[n] : 
n = 0 : 100} agree with G(£2) for £2 = 0 : 0.01 : 2tz1 You can use the 
following program “sig04p_06.m”. 

(d) Find the step response, i.e., the output of the system to the unit step input 
x[n ] = u s [n] in two ways; once using the z-transform and once using the 
iterative method for n = 0 : 4. Is the steady-state value the same as the DC 
gain obtained in (b) and the result of applying the final value theorem? 

(e) Find the z-transform Y[z\ of the output to a sinusoidal input x[n] = 
sin(«7r/2)w iS [«]. Find the steady-state response of the output by taking the 
inverse z-transform of Y[z\ or using the frequency response obtained in (b). 
Support your analytical solution by plotting it together with the iterative 
(numerical) solution for n = 0 : 100. Could you apply the final value 
theorem? If not, state why it is not possible. 


%sig04p_06.m 
clear, elf" 
disp (' (a) ' ) 
syms z 

% Cjz-s z* (z+1) / (z~2—z+0.5) ; 

Gz= z* (z+1)/(z-0.5+0.5i)/ (z-0.5-0.5i); 
B=[1 1]; A=[1 -1 0.5]; 
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disp (' (b) ' ) 

DC_gain=subs (Gz, M; : , exp (j*0 >). 

[I!C gain subs (GzJ X' ,exp (j*pi/24 ) subs (Gz, ' z' , exp (>pi) ) ] 
disp('(c)') % Impulse response and frequency response 
g= iztrans(Gz) 

% To solve a dif fdrer.ee equation by iteration 
gn (: ) -=0; gri (2 f =& ■, % initial conditions 

xc= zeros(1,103); xc(3)=l; % unit impulse input 
r=l/sqrt(2); Wl=pi/4; 

■for m=3:103 

gn(*}s gn;(m-l) - 0.5*gn(m-2) + sscUw) # xc(m-l); 
n=m-3; gn.iztrans (m-2) = eval (g) ; 

gn_iztrans_hand (m-2) = r~n* (cos (Wl*n) +3*sin(Wl*n) ) ; 

gn=gn (3 : eftS'jgn(l:4) 
discrepancy_gnl= norm (gn-gn_iztrans) 
discrepancy_gn2= norm (gn-gn_iztrans.hand) 

W=0:0.01:2*pi; 

GW_DTI>T= DTFT (gn,W, 0) ; 

GW= freqz(B,A,W); 

discrepancy _GW= norm (GW-GW_DTFT) 


4.7 Sinusoidal Steady-State Response from z-Transform or Frequency Response 
Consider a causal system which has the following system function: 

H[z\ = ] —^ (P4.7.1) 

z - e~ l 

Find the output of the system to a sinusoidal input x\n\ = sin(0.27r«)u 5 .[n] in 
the following two ways: 

(a) Using the z-transform, show that the sinusoidal response is 

y[n] = (0.688e _n + 0.5163 sin(0.27rn) — 0.688 cos{0.2n n))u s [n] 

= (0.688e _n + 0.8602sin(0.27rn - 53.1°))w s [n] 

= (0.688e _n + 0.8602 sin(0.27r(n - 1.4754)))u,[u] (P4.7.2) 


(b) Based on the fact that the frequency response at £2 = 0.27T is 


H[e* a ] | 


1 — e _1 

e j0.2n _ e -l 


1 — e~ l , sin(0.2^r) 

= - Z — tan -- 

V( C os(0.27r) - e- 1 ) 2 + sin 2 (0.27r) cos(0.2tt) - e" 1 

= 0.8602Z - 0.927 (P4.7.3) 


find the sinusoidal steady-state response excluding the transient response which 
decays as time goes by. 
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4.8 System Function and Frequency Response from Input and Output 
Consider a causal system which has the following input and output: 

x[«] = r n cos{Q.\ri)u s [n] (P4.8.1) 

y[n] = r" sin(£2in)n s [n] (P4.8.2) 

(a) Find the system function G[z] = Y\z\/X\z\ and impulse response of this 
system. 

(b) Find the frequency response G(Q.) = G\e' n ] and its peak frequency. 

4.9 Goertzel Algorithm [G-2] 

Consider two second-order filters whose impulse responses are 

gi[n] = cos(2nkn/N)u s [n\ (P4.9.1a) 

g 2 [n] = sin(27 xkn/N)u s [n\ (P4.9.1b) 


(a) Show that for the input of real-valued sequence {x[ri]\ 0 < n < N — 1}, the 
outputs of the two filters at n = N become the real and imaginary parts of 
N -point DFT X{k) = DFT, v {x[n]}: 

VuML^at = ELo x[m]gi[N - m ] (P4.9.2a) 

/ 2 jtkm \ 

= E m=0 x[m]cos J = XR(k) 

yik[n]\ n=N = X! m=0 x M8i[N - m] 

= - sin ( 27 ^ W ) = Xi ^> (P4-9.2b) 


where 

X{k) = DFT, V \x[n]} <3 = 2 ' x[m] Wf = ^ x[m]e" 7 ' 27rte/iv 

(P4.9.3) 

X R (k) + jX,{k) = ^2 m=0 x[m] cos 

(2nkm\ 

- j E ffl=0 x[m] sin (-jy- j (P4 - 9 - 4) 

(b) Taking the z-transform of the impulse responses (P4.9.1a,b), find the sys¬ 
tem functions of the filters and check if they can be implemented as 
Fig. P4.9. 
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Fig. P4.9 The signal flow graph for Goertzel algorithm 

(c) The structure of the filter which generates the DFT sequence of a given 
input sequence can be obtained from the following equation: 

ydn] = X^” o ; *[«] W- k(n ~ m) = x[n] * W~ kn (P4.9.5) 

Comparing this equation with the DFT definition (P4.9.3), we see that the 
value of the output (P4.9.5) at n = N is the same as the DFT of x\n\. 

ydn]\ n=N = y k \_N] = X!„ i=0 x \m]W~ k(N ~ m) 

= J2 N m _' 0 x [«] W N m = x(k ) (P4.9.6) 

Noting that (P4.9.5) is the output of a filter with the impulse response 

g[n] = W~ kn = e j2 * kn/N (P4.9.7) 

show that the system function of the filter is 



i - w^z 

1 -2cos(27r k/N)z~ x +z ~ 2 

1 — cos(2 Tzk/N)z~ l + j sin(27r£/A0z -1 
1 -2cos(2 jrk/N)z~ l +z ~ 2 


(P4.9.8) 


(cf) This filter is not stable in view of the BIBO stability criterion (1.2.27b). 
However, we will use them for only a finite number of time points, 
ensuring that their outputs do not become infinite. 
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In this chapter we are concerned how continuous-time and discrete-time signals are 
related with each other. We will cover the following: 

- Basic functions of D/A (digital-to-analog) converter, A/D (analog-to-digital) 
converter, and S/H (sample-and-hold) device 

- Relationship between the CTFT and DTFT and the effect of sampling on the 
spectrum of a continuous-time signal 

- Sampling theorem 

- Reconstruction of the original signal from the sampled signal 

These topics will not only give an insight into the relationship between continuous¬ 
time signals and discrete-time signals, but also help you to realize what the sampling 
really means. 

Sects. 5.1 and 5.2 are based on the tutorial notes of Richard C. Jaeger ([J-l] 
and [J-2]). 
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5.1 Digital-to-Analog (DA) Conversion[J-l] 

The basic function of the D/A (digital-to-analog) converter (DAC) is to convert a 
digital (binary) number into its equivalent analog voltage. The output voltage of the 
DAC can be represented as 

Vo = V FS {di2~ l + d 2 2~ 2 + • • • + d N 2~ n ) + V os (5.1.1) 

where 


v 0 : Output voltage 

Vfs : Full-scale output voltage 

V os : Offset voltage (normally to be adjusted to zero) 

d\d 2 ■■ -du: /V-bit input word with the (fictitious) binary point at the left, the 
most significant bit (MSB) d\, and the least significant bit (LSB) d N . 

The resolution of the converter is the smallest analog change that may be 
produced by the conversion and is equal to the value of the LSB in volts: 

Resolution (in volts) = 2~ N V F s = 1LSB value (5.1.2) 

It is often stated as a percentage of full scale ( 2~ N x 100%) or just /V-bit resolution. 

Figure 5.1 shows an inverted R-2R ladder network, which can be used as a 3-bit 
DAC where the binary input word controls the switches with a signal of logical value 
‘l’/‘0’ indicating a transfer to OP Amp/ground side. Taking successive Thevenin 
equivalent circuits for each stage of the ladder, it can be shown that the input currents 
are each reduced by a factor of 2 going from the MSB to the LSB so that the analog 
output voltage to a 3-bit binary input d\d 2 d 2 becomes 

Vo = Rio = R (d x ^ + d 2 ^ ) = (</|2 1 + d 2 2“ 2 + d 3 2" 3 ) V/s 

(5.1.3) 



Fig. 5.1 An inverted R-2R ladder network used as a DAC 



5.2 Analog-to-Digital (AD) Conversion[G-l, J-2, W-2] 


Note that the currents flowing in the resistors are kept constant since the digital 
input diverts the current either to ground or to the input (virtual ground) of the 
operational amplifier functioning as a current-to-voltage converter. 

5.2 Analog-to-Digital (AD) Conversion[G-l, J-2, W-2] 

An analog-to-digital converter (ADC) takes an unknown analog input signal, most 
often a voltage V x , and converts it into an N -bit binary number D representing the 
ratio of V x to the converter’s full-scale voltage V F s- 

Most ADCs use a DAC to vary the reference voltage V r and use a logic cir¬ 
cuit including one or more comparators to deteremine one of the 2 N possible 
binary numbers D — d\di - ■ ■ d,\r (d,’s: binary coefficients) which can represent 
the unknown voltage V x . The reference voltage V r can have 2 N different values as 

V r = V FS Y^ =1 d i 2 ~ l (5.2.1) 

where V F $ is the DC reference voltage. The basic difference in converters consists in 
how to vary V r to determine the binary coefficients dj ’s such that the error V x — V, 
is minimized. 

5.2.1 Counter (Stair-Step) Ramp ADC 

The counter ramp ADC illustrated in Fig. 5.2(a) starts to increment the N -bit 
counter value from zero by one per clock period on the SOC (start of conver¬ 
sion) pulse till the reference voltage V r exceeds the unknown input voltage V x . 




Fig. 5.2 Counter ramp ADC 
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The sequentially increasing counter output is applied to the N -bit DAC, making 
its output V r go up like a staircase as depicted in Fig. 5.2(b). The reference voltage 
V r is applied to the — input terminal of the comparator and compared against V x 
(applied to the + input terminal) by the comparator. The comparator output keeps 
to be ‘T so that the counter will continue to increase normally till V r exceeds V x . 
When V r > V x , the comparator output will be switched to ‘0’ so that no further 
clock pulse can increment the counter value and the EOC (end of conversion) signal 
becomes high to tell other devices that an A/D conversion cycle is completed and the 
counter value represents the converted (digital) value of the unknown analog voltage 
V x . Fig. 5.2(c) shows typical variations of the analog input, reference voltage, digital 
output, and conversion time. 

Some features of this converter should be noted: 

< Advantage > 

- The simple hardware makes the counter ramp ADC inexpensive to implement. 
<Disadvantages> 

- The conversion time is proportional to the value of V x . In the worst case where 
V x is equal to or greater than the value of the maximum binary number, i.e., V x > 
(1 - 2 ~ n )V fs , it becomes 

T c = 2 N /f c (2 N clock periods) (5.2.2) 

where f c is the clock frequency and Vfs is the full-scale DAC output voltage. 

- The DAC output is not necessarily the closest to V x , but the smallest just over V x 
among the 2 N possible binary numbers. 


5.2.2 Tracking ADC 

The tracking ADC tries to improve the conversion performance by using an up-down 
counter with logic to force the DAC output V r to track changes in the analog input 
V x (see Fig. 5.3). Depending on whether V r < V x or V r > V x (as indicated by 
the comparator output), the counter value is incremented or decremented by the 
clock pulse so that the DAC output will alternate between two values differing by 
one LSB value (2 -iV ) when V x is constant. When the analog input V x varies, V r 
changes in the proper direction towards V x so that V r follows V x . Consequently, if 
V x varies slowly enough, the DAC output V r is continuously close to V x and the A/D 
converted value may be read from the counter at any time. However, if V x varies too 
rapidly, the DAC output V, will not be able to catch up with V x quickly enough to 
make the counter value represent V x closely at any time. The main drawback is the 
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(a) Block diagram (b) Timing diagram 


Fig. 5.3 Tracking ADC 

phenomenon called ‘bit bobble’ that the output is never stable since it switches back 
and forth with every clock pulse even for a constant analog input V x = const. 

5.2.3 Successive Approximation ADC 

The successive approximation ADC uses a binary or bisectional search method to 
determine the best approximation to V x , requiring only N clock periods to complete 
an N -bit conversion. Figure 5.4 shows its block diagram and timing diagram. At 
the start of conversion, the SAR (successive approximation register) is reset with its 
MSB set to ‘T, resulting in the DAC output 

V r ^2~ l V FS 

At the next clock pulse, depending on whether V r < V x or V r > V x (as indicated by 
the comparator output), the MSB is left on (‘1’) or set to ‘0’ and the 2nd MSB is set 
to ‘T, resulting in 

V r «- V r + 2~ 2 V fs or V r <-V r - 2~ 2 V fs 



(a) Block diagram (b) Timing diagram 

Fig. 5.4 Successive approximation ADC 
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110 

101 

100 

011 

010 

001 

000 


Fig. 5.5 Binary code sequence of a 3-bit successive approximation DAC 


Again, depending on V r < V x or V r > V x , the 2nd MSB is left on(‘l’) or set to ‘0’ 
and the 3rd MSB is set to ‘1’, resulting in 

V r ^V r + 2~ 3 V fs or V r ^V r - 2~ 3 V fs 

When the process has been carried out for every bit, the SAR contains the binary 
number representing V x and EOC line indicates that digital output is available. In 
this way, the 3-bit successive conversion is completed at the end of N clock periods 
for an N -bit ADC so that we have the A/D conversion time 

T c = N/f c (N clock periods) (5.2.3) 

Figure 5.5 shows the binary code sequence of a 3-bit successive approximation 
DAC. 

This type of converter is very popular due to its fast conversion rate. A problem 
with the SA ADC is that if the input does not remain constant during the full con¬ 
version period, the digital output may not be related to the value of the unknown 
input voltage V x . To avoid this problem, sample-and-hold circuits are usually used 
ahead of the ADC. 


5.2.4 Dual-Ramp ADC 

Figure 5.6 shows the organization and operation of the dual-ramp ADC. On the SOC 
pulse, the counter and RC integrator are reset. Then the analog input V x , connected 
to the integrator input through switch Si, is (negatively) integrated during a fixed 
time interval of T\ = 2 N /f c . At the end of the integration period, the two switches 
S1/S2 are turned off/on, respectively so that the reference input — V F s are connected 
to the integrator input through S2. Then the integrator output v H increases until it 
crosses zero to make the comparator output change. The length of the deintegration 
period will be measured as 7) = ni/fc (>12 clock periods). 
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where T\ = 2 N jf c and V x is the average of V x . This implies that the counter value 

«2 accumulated during the deintergration period is supposed to represent the average 

value of the analog input: 

n 2 = 2 n ^~ (5.2.5) 

VFS 

The value of RC constant does not matter as long as it remains constant throughout 

the conversion cycle of duration 7) + T 2 . 

< Advantage > 

- Even if V x changes during the conversion cycle, the ADC output corresponding to 
V x is still valid since it represents the average value of V x during the integration 
period of duration 7) =2 N /f c . 

- Any sinusoidal input signals with frequencies K/T\ = K2~ N f c (K: an integer) 
will have integrals of zero so that they will not disturb the ADC output. This 
property is utilized in digital voltmeters which use dual-ramp converters with 
T\ = K /f 0 where f 0 is the power-line frequency (50 or 60Hz), so that har¬ 
monic noise at multiples of f„ can be removed (‘good rejection of power-line 
interference’). 

- Reversed polarity of the analog input V x can easily be dealt with by reversing the 
polarity of -V FS . 

<Disadvantages> 

- The conversion time is variable and is as long as 


T C = T\ +T 2 = (2 n + n)/f c 


( 5 . 2 . 6 ) 
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5.2.5 Parallel (Flash) ADC 

Figure 5.7 shows a 3-bit parallel (or flash) ADC in which the analog input V x is 
simultaneously compared with (2 3 — 1) different reference values and depending on 
the comparison results, one of the 2 3 digital values is chosen as the ADC output by 
the encoding logic circuit. 

< Advantage > 

- The conversion speed is so fast that the parallel ADC can be thought of as 
automatically tracking the input signal. 

- With the resistors of no-equal values, the parallel ADC can be designed so that 
it performs a customized, nonlinear A/D conversion. No other ADC design is 
capable of such a nonlinear AD conversion. 

< Disadvantage > 

- The cost is expensive and grows rapidly with resolution since 2 N — 1 comparators 
and reference voltages are required for an N -bit converter. 


(cf.) Visit the web site [W-2] to see the delta-sigma (AS) ADC. 
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5.3 Sampling 

5.3.1 Sampling Theorem 


In Sect. 3.5.2 we derived the relation between the CTFS X * of a continuous-time 
periodic signal Xp{t) and the N -point DTFS (DFS/DFT) X N (k) of the discrete-time 
version Xjvfn] = xp(nT) (obtained by sampling xp(t) every T s), which is periodic 
with period N — P/T in n: 

oo Xk+mN (53 - la) 


where the frequency components described by the DTFS X N (k) and CTFS Xp are 
virtually identical in light of the inter-relationship (1.1.15) between the digital and 
analog frequencies: 


k£2 0 = 


k — [rad/sample] 

N 

^ 271 / /V [rad/sampl e] ^ 2n 
T [sec/sample] NT 


[rad/sec] = 


= ka>o 


We also showed that the CTFT XJco) of a continuous-time signal x a (t) is related 
with the DTFT X d {£l) of the discrete-time version x d [n] = x a (nT) as 


X d {i 2) 


(3.5.7) 




l®=£2/r 


(5.3.1b) 


where w = Q/T [rad/s] and £2 [rad/sample] are virtually identical in light of the 
inter-relationship (1.1.15) between the digital and analog frequencies. 

Equations (5.3.1a) and (5.3.1b) imply that the DTFS/DTFT of a discrete-time 
sequence x d [n] = x a (nT) is qualitatively the periodic extension of the CTFS/CTFT 
of the continuous-time version x a (t ) (with period 2 n/T in analog frequency co or 
27 x in digital frequency £2), i.e., the sum of infinitely many shifted version of the 
spectrum of x a (t). This explains how the DTFS/DTFT spectrum of x d [n] = x a (nT) 
deviates from the CTFS/CTFT spectrum of x a (t) due to frequency-aliasing unless 
the CTFS/CTFT is strictly limited within the low-frequency band of {—n/T, n/T) 
where T is the sampling interval or period of x d [n] = x a (nT). 

To be more specific, suppose a continuous-time signal x a {t) has a band-limited 
CTFT spectrum 


X a {w) = 0 for \co\ > co x (5.3.2) 

as depicted in Fig. 5.8(a). Then the DTFT spectrum X^(£2) of the discrete-time ver¬ 
sion x d [n] = x a {nT), which is the periodic extension of X a (co )\with period 



258 

5 

Sampling and Recc 

mstruction 


—UJ X 0 

(a) The spectrum of x a [t] 

v tew. Frequency response 
Xdy* 1 ) 1 of an ideal LPF 
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Fig. 5.8 The spectra of discrete-time signals depending on the sampling frequency - the sampling 
theorem 


w s = 2n/T in 0) or = 2jt in £2, is shown in Fig. 5.8(b) and (c) for n/T > co x 
and Jt/T < w x , respectively. Notice that X d (Q) in the principal frequency range 
(—tt/T, tt/T) is identical to X a (co) if 

w s — — > 2<w x (Nyquist rate) or equivalently, —(folding frequency) > o> x 

(5.3.3) 

where (o x is the highest frequency in x a (t) and co s = 2n / T and tt/T are called 
the sampling frequency and folding or Nyquist frequency, respectively. In this case 
(Fig. 5.8(b): oversampling), there is no overlap, called aliasing, between adjacent 
spectral components so that x a (t) or X a (co) can be extracted exactly from x d [n] = 
x a {nT) or X d (fT) by employing an ideal lowpass filter with the magnitude response 
depicted (in a dotted line) in Fig. 5.8(b). 

On the other hand, in the case of Fig. 5.8(c) (under-sampling) with n/T < co x 
or equivalently, co s = 2n/T < 2w x , the frequency aliasing (or spectral overlap) 
occurs, producing an irretrievable error in the spectrum. Such an aliasing phe¬ 
nomenon makes higher frequencies in X a {w) get reflected into lower frequencies, 
which presents an interpretation of the stroboscopic effect. This effect is occasion¬ 
ally observed in films of wagon wheels or aircraft propellers that appear to be 
rotating slower than would be consistent with the forward motion and sometimes 
in the opposite direction. This story can be summarized as follows: 


[Sampling Theorem] 

In order to retain vital information through sampling with sampling period T, 
the sampling frequency co s = 2 tt/T must be greater than twice the highest fre¬ 
quency co x contained in the continuous-time signal x a (t) to be sampled, called 
the Nyquist rate 2w x . Otherwise, i.e., if co s < 2w x , the so-called frequency 
aliasing effect (spectral overlapping phenomenon) results. 
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When sampling a continuous-time signal x a (t) every T s, we want to ensure that 
all the information in the original signal is retained in the samples xj[n] = x a {nT) 
so that we can exactly recover x a (t ) from the discrete-time sequence x ( i\n]. In this 
context, the sampling theorem is the most important criterion of the sampling period 
selection. 

To clarify the concept of aliasing, consider two continuous-time signals x\(t) = 
sin(27rf) and x-i(t) = sin(227rt) shown in Fig. 5.9(a). Each of these signals is 
sampled every T = 0.1s to give sequences x\[n\ — xi(O.ln) = sin(0.2jrn) 
and X2[ri\ = X2(0.1 n) = sin(2.2:rr«), that are identical. Fig. 5.9(b) also shows 
that two continuous-time signals X3 (t) = sin(18;rt) and X4(t) = — sin(2 Tit) 
are sampled every T — 0.1s to yield x^\n] = *3(0.In) = sin( 1.87m ) and 
x 4 [n] = X4(0.1n) = sin(—0 .2jtn), that are identical. These are examples of fre¬ 
quency aliasing that a higher frequency signal, when sampled, appears like a lower 
frequency one. 

Figure 5.10 shows the output signals yi(t), yi (t), and y^{t) of an A/D- G[z] 
(digital filter)-D/A structure to the three different input signals where G[z] m 
(1 — e _1 )/(z — e _1 ). Note that with the sampling period T = 0.1 [s], all the 
outputs are of the same digital frequency and that X2Q) = sin(22jrf) and X3 (t) = 
sinf 1877/) have been aliased/folded with the phase preserved/reversed, respectively. 
This result can be obtained by running the following program “sig05fl0.m” and 
predicted from the frequency response of the digital filter G[z], which is shown in 
Fig. 5.11. 



(a) x,[n] and x 2 [n] obtained by sampling x,(f) = sin (2rf) and x 2 (f) = sin (22rf) with 7=0.1 



Fig. 5.9 Examples of frequency aliasing/folding or spectral overlap 
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(a) The magnitude response of the digital filter G[z] 



(b) The phase response of the digital filter G[z\ 
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subplot(523), plot(t,x2t), hold on, stairs(n*T,x2xi,'r') % Input 2 
subplot (524) , stairs (n*T, y2n) % Output 2 

subplot (525) , .plot (t,x3t) , hold on, stairs (n*T,s$S$^*45*) % Input 3 

subplot(526), stairs(n*T,y3n) % Output 3 

% The frequency response of the digital filter 

W=[-2:0.001:2.3]*pi; GW=freqz(B,A,W); 

subplot (5: 4) , plot (f,abs (GW) ) 

subplot (5‘. 5) , plot (f, angle (GW) ) 


Referring to Remark 1.4 (for the physical meaning of the frequency response) 
and based on the frequency response of the digital filter G[z ] depicted in Fig. 5.11, 
we can write the steady-state response of the digital filter to the digital inputs 
X\ \n\ = sin(0.27rn) and x^[n] = sin(1.87rn) as 

y\\n ] = | G[e jCi ]\\ Q=O2n sm(0.2nn + ZG[e jC2 ]\ n=02n ) 

= 0.86 sin (0.2nn — 0.927) 

y 3 [n] = | G[e JCi ] | =18jr sin(1.87rn + ZG[e j€l ]\ a=l gjr ) 

= 0.86 sin (1.8;rn + 0.927) 

= 0.86sin(-0.27in + 0.927) = -0.86sin(0.2?™ - 0.927) = -y x [n] 

Here, let us think about how we can interpret the periodicity of the DTFT spectrum 
of a discrete-time signal and that of the frequency response of a discrete-time sys¬ 
tem such as G[z]. The interpretation of the former is an ambiguity that we cannot 
tell which of analog frequency components {(S2i ± 2mn)/T, m: any integer} are 
contained in the original continuous-time signal (before sampling with period T ). 
It should not be interpreted as the existence of infinitely many analog frequency 
components {(£2i ± 2mn)/T, m : any integer}. On the other hand, the interpre¬ 
tation of the latter is an equality that the discrete-time system responds with the 
same magnitude and phase of frequency response to the discrete-time version of 
continuous-time signals of different analog frequencies {(fl| ± 2imt)/T, nr. any 
integer}. 

There are some rules of thumb for choosing the sampling rate, which are listed 
in the following remark: 

Remark 5.1 Rules of Thumb for Sampling Rate Selection 

In practice, the sampling frequency is chosen to be much higher than the Nyquist 
rate. In closed-loop sampled-data systems, low sampling rate has a detrimental 
effect on stability and therefore, the sampling rate selection is made with stability 
consideration. The rules of thumb are 

- to sample 8 ~ 10 times during a cycle of damped oscillation in the output if the 
system is under-damped or during the rise time of the transient response if the 
system is over-damped, or 

- to sample at least 5 times per time constant. 
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Remark 5.2 Time Aliasing and Frequency Aliasing 

In Example 3.15, it can be observed that if the DFT size is not sufficiently 
large, in other words, if the sampling rate in the frequency domain [0, 2n] is not 
sufficiently high, the aliasing problem may occur in the time domain and such a 
phenomenon is called the time aliasing. Now in this section, we can observe that a 
low sampling rate in the time domain may cause the frequency aliasing. 


5.3.2 Anti-Aliasing and Anti-Imaging Filters 

We know that higher sampling rate satisfies the sampling theorem more easily; in 
other words, if a continuous-time signal is sampled at a sufficiently high rate, the 
frequency-aliasing problem can be alleviated. However, the maximum sampling rate 
of a S/H (sample/hold device) is upper-bounded by the hardware constraints such 
as the delay time of the S/H and the conversion time of A/D (analog-to-digital) 
converter. If the total conversion time is 1 |xs, the maximum sampling rate is 1 MHz. 
Therefore we may not be able to make the sampling rate as high as we want. 
Besides, a higher sampling rate increases the number of calculations needed for 
implementation. 

On the other hand, all physical signals found in the real world are not band- 
limited and do contain a wide range of frequency components. Besides, an ideal 
low-pass filter is not realizable. It is therefore impossible to exactly reproduce the 
original continuous-time signal from its sampled version even though the sampling 
theorem is satisfied. 

Fortunately, most physical transients tend to be smooth so that their spectra are 
close to zero for high frequencies. Still it may be a problem to deal with the signal 
corrupted by high-frequency noise. To prevent or reduce aliasing errors caused by 
undesired high-frequency signals, we must use an analog low-pass filter, called an 
anti-aliasing prefilter. This filter is applied to the continuous-time signal prior to 



Fig. 5.12 Block diagram and frequency response of a DSP system 






5.4 Reconstruction and Interpolation 


263 


sampling and passes the components with frequencies |co| < co c , while attenuat¬ 
ing the components with \co\ > co s — co c , which would be folded into the range 
\w\ < oj c . A digital signal processing system using an anti-aliasing LPF and its 
typical frequency response are shown in Fig. 5.12. Note that another LPF of similar 
frequency characteristic, called an anti-imaging or reconstruction filter, might have 
to be installed after D/A conversion to remove unwanted spectral components 
(above the folding or Nyquist frequency cof = n/T) from the DAC output and 
construct a smooth analog output signal. 


5.4 Reconstruction and Interpolation 

In many practical applications, discrete-time sequences are required to be trans¬ 
formed into continuous-time signals. In computer-controlled systems, it is necessary 
to convert the control actions calculated by the computer as a sequence of numbers 
into a continuous-time signal that can be applied to the plant or process. In digital 
audio compact disk system, the audio signals are stored as digital samples on the 
disk and must ultimately be converted into analog signals to drive the speakers. In 
these cases, we are faced with the inverse of the sampling operation, which asks us 
to think about how to reproduce the analog signal x a (t ) from the continuous-time 
sampled signal xjt) = x a (t)Sr(t) or discrete-time sequence x,\[n] = xfinT). 


5.4.1 Shannon Reconstruction 


We begin by considering the un-aliased spectrum XJco) as shown in Fig. 5.8(b) 
where XJco) has the same shape with the original spectrum XJco) over the principal 
frequency range (—n/T, n/T) where T is the sampling interval or period. Sup¬ 
pose we have an analog lowpass filter (LPF) with the ideal ‘brick wall’ frequency 
response 


GJco) 


T for - n/T < 
0 elsewhere 


< n/T 


(5.4.1) 


which passes only frequencies in the range \co\ < n/T and masks out all other 
frequencies. Recall from Eq. (E2.9.2) that 


= T B - si„c(!) *= ,r sine (i) (5.4.2) 


We can apply this filter to XJco) to retrieve the original spectrum X a (w) in the 
frequency domain as 


X(co) = G fiofiXfico) 


(5.4.3) 


or in the time domain 
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x(t) = r~ l {X{w)} (2 = 10) g,(t) * xjt) (E2 = 31) g,(t) * x a (t)S T (t) 

m = 1) gAt)*x a (t) TZ=-J {t ~ mT) 

= 8i(t) * J^A^Xait)8(t - mT ) = g,{t) * YZ=-oo Xa{mT)8{t ~ mT) 
x(o ( 5 = 2 > e:_ sinc ^ j T ^ ( 5A4 ) 


The above summation (5.4.4), called Whittaker’s cardinal interpolation formula or 
Whittaker-Shannon sampling series [S-l, W-l], suggests a reconstruction formula. 
It can be modified into a more computationally-efficient form 




(5.4.5) 


where we have used the fact that 

sin ~ mT )^ = sin cos (m jr) — cos sin(m it) = (— 1)'" sin {r^t) 


Since the sinc function sinc(? — mT) has unity value for t = mT and becomes zero 
for other Shannon reconstruction sample points, it is obvious that 

x(nT) = x a (nT) V integer n (5.4.6) 

holds for every sample point. The role of gi(t) is to fill in or interpolate the values 
of the continuous-time function between the sample points. 
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(a) An example of Whittaker-Shannon reconstruction 

when the precondition of the sampling theorem is satisfied 



—3 J 

(b) An example of Whittaker-Shannon reconstruction 

when the precondition of the sampling theorem is not satisfied 

Fig. 5.13 Examples of Whittaker-Shannon reconstruction 


Interested readers are recommended to run the above program “sig05fl3.m” 
twice, once with the number of frequencies K = 5 and once with K = 6, to get 
Fig. 5.13(a) and (b), respectively and then, think about what the difference comes 
from in connection with the precondition of the sampling theorem. 


5.4.2 DFS Reconstruction 

Recall again the relationship (5.3.1a) between the CTFS X* of a continuous-time 
periodic signal Xp{t) and the N -point DTFS (DFS/DFT) X N (k) of the discrete-time 
version x, v [«] = x p(nT) (obtained by sampling Xp(t) every T s), which is periodic 
with period N = P/T in tv. 

X N {k) (3 ' 53) °= (531a) I J2Z-O0 (5A7) 

This implies that if xp(t) does not contain the frequencies above the folding 
frequency, i.e., half the sampling frequency 
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(O s 71 



N 2n 
~2 ~N~T 


N2n 

~2~P 


N 

2 


(^(corresponding to the frequency index k = 


N 

~2 


) 


so that 


x k = 0 V |*| > - 


then Eq. (5.4.7) becomes 


(5.4.7) with (5.4.8) 1 


This suggests another reconstruction formula, called the DFS reconstruction, which 
is similar to the inverse DFS formula (3.4.8): 


*(0=^ E X N (k)e j2nktlN 


%sig05fl4.m 
clear, elf 

ts=0.001; T=0.1; tt=-0.5:ts:1.4; t0=0; tf=l; 

fs=[0 0.1 0.2 0.3 0.4 0.5]; ws=2*pi*fs/T; % Frequencies contained in x(t) 
Aks= [111111]; phiks= [0.5 -0.5 0.5 -0.5 1 -1]; 

K=5; xt= Aks(1)*sin(ws(1)*tt + phiks(l)); 

for k=2:K, xt = xt + Aks(k)*sin(ws(k)*tt + phiks(k)); end 

nT= tt([l:T/ts:end]); xn= xt([1:T/ts:end]); 

xn_causal= [xn (6 rend) xn(l:5)]; Xk= fft (xn.causal) ; N=length (Xk) ; 
plot (tt,xt), hold on, stem(nT,xn) 
kkl=[1:N/2].'; 

xhtl_DFS= real(Xk(kkl)*exp(j*2*pi/N/T*(kkl-1)*tt))/N; 
kk2=[N/2+2:N].'; 

xht2JDFS= real(Xk(kk2)* e xp(j*2*pi/N/T*(kk2-l-N)*tt))/N; 
xht_DFS = xhtl_DFS + xht2_DFS; 

plot(tt, xht-DFS, ' r') , set(gca,'XLim', [tO tf],'fontsize' , 9) 


Interested readers are recommended to run the above program “sig05fl4.m” 
twice, once with the number of frequencies K = 5 and once with K = 6, to get 
Fig. 5.14(a) and (b), respectively and then, think about what the difference comes 
from in connection with the precondition of the sampling theorem. 
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(a) An example of Fourier series reconstruction 

when the precondition of the sampling theorem is satisfied 



(b) An example of Fourier series reconstruction 

when the precondition of the sampling theorem is not satisfied 


Fig. 5.14 Examples of Fourier series reconstruction 


5.4.3 Practical Reconstruction 


The problem with the ideal (Whittaker-Shannon) interpolation function gi(t) — 
sine (t/T) is that it extends in time from t = —oo to +oo and accordingly, it incor¬ 
porates the entire sequence of x a (nT) including all the future samples (for n > 0) 
as well as all the past samples (for n < 0) to find the estimate of x(t). Besides, in 
control situations we cannot usually wait to observe the entire sequence before an 
interpolation is performed. In this section we consider a practical interpolator called 
the zero-order hold (z.o.h.), which is a causal lowpass filter to approximate a signal 
between two consecutive sampling instants nT and (n + 1 )T by a constant x a (nT). 
This is the beginning of the story about the ideal S/H (sample-and-hold device). As 
depicted in Fig. 5.15(a), the output of a z.o.h. to an input x(t) can be described as 


m = J2Zo Xa{nTHuAt - nT) - Us(t ~ nT ~ T)) (5A11) 

whose Laplace transform is 

B.8(3), B.7(2) 'n=0 s ) 

= E„=o Xa(n7 ’ )e ^ rs “ (1_ e ” rs); (5A12) 


X(s) = X*(s)G h0 (s) 


(5.4.13) 
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Fig. 5.15 S/H (Sample-and-Hold) modeled by combining an ideal sampler and a z.o.h. 


where 


X,(i) = £{x*(l)} 

B.gp) ^-voo 


m = l) c\x a (f) J^Z-oo S(t ~ nT) \ 

x a (nT)e~ nT5 (4 = !) X d [z]\ z = e ,r 


,( 5 . 4 . 13 ) X(s) ( 5 . 4 . 12 ) 1 _ T 
G h0 (s ) = —— = -(1-e ls ) 

X*(s) ( 5 . 4 . 14 ) s 


(5.4.14) 

(5.4.15) 


Note that in Eq. (5.4.13) describing the Laplace transform of the z.o.h. output, 
Xfs) is the Laplace transform of x*(?) = x a (t)S T (t) (the output of an ideal sampler 
to x a (t)), called the starred transform of x a (t). On the other hand, G;,oCv) can be 
regarded as the system or transfer function of the z.o.h. device since it does not 
depend on x a (t). Hence the frequency response of the z.o.h. is 


Gmija)) = Gho(s)\ s =j<» — —(1 — e 
; ja> 

_ sin(fe>r/2) _j mT /2 
wT/2 e 


which imphes that the z.o.h. is a kind of lowpass filter (see Lig. 5.15(b)). Note that 
x*(t) is not present in physical systems, but it appears in the mathematical model 
as a result of factoring and can be considered to be the output of an ideal sampler. 
Although the ideal sampler and the z.o.h. do not individually model a physical sam¬ 
pler and a physical data hold, their combination does accurately model a physical 
S/H device (see Lig. 5.15(c)). 
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5.4.4 Discrete-Time Interpolation 

As mentioned in Remark 3.7(4), zero-padding in the time domain can be used to 
increase the frequency resolution, which is justified for finite-duration signals that 
have already been sampled over all nonzero portions. In duality with this, zero¬ 
padding in the frequency domain can be used to increase the time resolution, which 
is justified for bandlimited signals having nonzero spectral values only for some 
finite frequency range. This suggests us a discrete-time interpolation method. 

Suppose we are given a sequence { x[n ], n = 0 : A — 1} where X(Q.) = 
F{x\ri\} — 0 for the frequency range near Q = n. We first obtain the A -point 
DFT of x[n], i.e., X(k) = DFT, v {x[n]J for k = 0 : A — 1 and then pad it with some, 
say, (K — 1 )N zeros to make a new KN -point DFT sequence V(k) as follows: 

<case 1: A is even> 


KX(k) for 0 < k < (A/2) - 1 and 

KN - (A/2) + 1 < k < KN - 1 
(K/2)X(k) for k = A/2, KN - (A/2) 

0 elsewhere (zero-padding) 


(5.4.17a) 


<case 2: A is odd> 


V{k) = 


KX(k) 

0 


for 0 < k < (A — l)/2 and 

KN — (A — l)/2 < k < KN — 1 
elsewhere (zero-padding) 


(5.4.17b) 


where X(k) = DFS,v{x[n]} is the periodic repetition of X(k) with period A. 

Now we compute the KN -point IDFT of V (k) to obtain an interpolation of 
x[n] as 


v [n] = IDFT^fy^)} 

= — y^ KN ~ l V(k)e i2nkn/KN forn = 0, 1, • • • , KN — 1 (5.4.18) 

KN ^k =o 

To evaluate this expression at every K th element, we substitute n = Km to get 
»[*»] = 

= IDFT A ,{X(k)} = x[m]form = 0, 1, •••, A-l (5.4.19) 

This implies that the new sequence v[n\ has been obtained by placing (K — 1) 
samples between successive samples of the original sequence x\n\. 
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(Q) In the case where x\ti\ is a real-valued sequence, it seems that we need to 
ensure the conjugate symmetry of its K N -point DFT V ( k ) by modifying a part of 
Eq. (5.4.17a) as 


\(K/2)X(k) for k = N/2 

V(k) = \ (5.4.20) 

\(K/2)X*(k) for k= KN - (N/2) 

However, we do not have to take the complex conjugate of X(N / 2) since it is real 
for a real-valued sequence x[ri\. 

Remark 5.3 Discrete-Time Interpolation, Zero Insertion, and Lowpass Filtering 
The DFT sequence V(k) is the same as the DFT of the output sequence of an 
ideal lowpass filter (with gain K and bandwidth n/K) to the input signal x<x)[n], 
which is obtained by inserting (K — 1) zeros between successive sample points of 
x[n]. From Eq. (3.2.14), we know that the KN -point DFT of X( K )[n] is 

X KN (k) = X N (k) fork = 0, 1, • • • , (KN - 1) : 

the periodic repetition of X(k) with period N 

Note that Eq. (5.4.17) is equivalent to taking a scaled version of X K (k) within the 
low frequency band, which corresponds to a lowpass filtering (see Fig. 5.16(b2)). 

Example 5.1 Discrete-Time Interpolation 

Let us find a discrete-time interpolation for the following sequence (see 
Fig. 5.16(al)): 


x[«]={2, 1, 0, 1} (E5.1.1) 

We first compute the N = 4 -point DFT of x[n] as (see Fig. 5.16(bl)) 

X(k) = DFT v {x[«]J = e~^ N = J2l =0 x[n] 

= x [0] + x [1] (~j) k + x [2] (~j) 2k + x [3] (~j) 3k 
= 2 + (-j) k + (-jf k - 

X(k) = {4, 2, 0, 2} (E5.1.2) 

Then we use Eq. (5.4.17) with K = 2 to get V(k) as (see Fig. 5.16(b3)) 

k =0 1 2 3 4 5 6 7 

V(k)={8, 4, 0, 0, 0, 0, 0, 4} (E5.1.3) 

Now, we compute the KN = 8 -point IDFT of V(k) to obtain the interpolated 
sequence v[ri\ (see Fig. 5.16(a3)): 
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(a3) v[n]\ lowpass-filtered (b3) V(Ky. zero-padded 


Fig. 5.16 Discrete-time interpolation of a discrete-time sequence 

v [»] = IDFT™{V(fc)} = ^ V(K)e j2nknl * 

— ^ (8 + 4e jnkn/4 + 4e~ j7rkn/4 ) = 1 + cos ^ knn ^ ; (E5.1.4) 

v[n]=~{ 2, 1.707, 1,0.293, 0, 0.293, 1, 1.707} 

This result can also be obtained by using the MATLAB routine ‘interpolation, 
discrete ()’, which implements the procedure described by Eq. (5.4.17) 
and (5.4.18). 

»x= [2 10 1]; K=2; 

>>v=interpolation_discrete(x, K) 

2.0000 l.ffgj 1.0000 0.2929 0 0.2929 1.00()0 1.7071 



:i= if ft (Xi) ; % Eq. (5.4 










272 


5 Sampling and Reconstruction 


5.5 Sample-and-Hold (S/H) Operation 

In a majority of practical digital operations, a S/H function is performed by a 
single device consisting of a capacitor, an electronic switch, and operational ampli¬ 
fiers, which stores the (sampled) input signal voltage as a charge on the capacitor 
(Fig. 5.17). OP amps are needed for isolation; capacitor and switch are not con¬ 
nected directly to analog circuitry lest the capacitor should affect the input waveform 
and should be discharged to the output. The mathematical model for a S/H device 
or operation has been developed in Sect. 5.4.3. 


Fig. 5.17 Sample-and-Hold 
(S/H) device 



The DAC described in Sect. 5.1 may be regarded as a device which consists 
of a decoder and an S/H unit (Fig. 5.18(a)). Note that the sampling operation 
is not necessary, but it is included since the S/H is usually considered as one 
unit. The ADC performs the operations of S/H, quantization, and encoding (see 
Fig. 5.18(b)). 


-*»| DAC; ' 



(a) A model for DAC 
Fig. 5.18 Models for DAC and ADC 




- | Quantizer | -»- | Enco der |-^ 
(b) A model for ADC 


5.6 Summary 

In this chapter we were concerned how continuous-time and discrete-time signals 
are and can be related. First, we have included a survey of D/A and A/D conver¬ 
sion methods to let the readers know the relationship between analog signals and 
the corresponding digital ones and further, to provide them with some practical 
information that may be useful for the selection of DAC and ADC. Then we dis¬ 
cussed the sampling theorem, several reconstruction/interpolation techniques, and 
the mathematical model of a practical S/H device. 
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Problems 

5.1 CTFS, DTFS, and Sampling Theorem 
Consider the following five cosine waves: 

Xi (t) = cos(27 Tt) = i(, e i2nt + e~ j2nt ) 

x 2 (t) = cos(8 nt) = ^(e jSnt + e ~ jint ) 

x 3 (t) = cos(10jt/)s I<^°« + e- J ' 107rf ) 

x 4 (f) = cos(18;rt) = * (V 18717 + e - - 718777 ) 

x 5 (t) = cos(22;r t) = ^(e j227tt + e~ j22nt ) 

(a) Referring to the Fourier representation formula (2.1.5a), verify that the 
Fourier series coefficients of the two-tone signal x a (t) = x\(t) + x 2 (t) 
with period P a = max{2n/2n, 2jz/%n} — 1 and fundamental frequency 
coq = 2 Tt are 

X a v — and - for k = —4, —1, +1, and + 4, respectively. 

2 2 2 2 

(P5.1.1) 

Also for the sequence {x a (nT), n = 0:9} obtained by sampling one period 
of the signal with sampling period T = 0.1, find the N — 10 -point DFT 
X(k) and discuss how it is related with X a ^ based on the relationship (3.5.3) 
between the CTFS and DTFS. Note that x a (nT ) can be written as 

x a [n] = x a (nT) = ^ 277n/li) + e ~^ w ) + l -( e ^ w + e~^ w ) 

(P5.1.2) 

and it can somehow be matched with the IDFT formula 
x [n] = IDFT w {X(jt)} (3 = 3) ^ X{k)e j2nkn/N for n = 0 : N - 1 

to yield the DFT coefficients X(k). 

(b) For Xb(t) = x\(t) + x 3 (t), do the same job as in (a). 

(c) For x c (t) = x\(t) + x 4 (f), do the same job as in (a). 

(d) For Xd(t) = x i (r) + x 5 (t), do the same job as in (a). 

(e) Complete the following MATLAB program “sig05p 01 .m” and run it to 
find the N — 10 -point DFTs for \x a (nT), n = 0:9}, {Xb(nT), n — 0 : 
9}, {x c (nT), n = 0 : 9}, and {x d (nT), n = 0 : 9}. Do they agree with 
those obtained in (a)-(d)? For each of the four cases (a)-(d), tell whether 
the frequency folding or aliasing occurs or not by the sampling with period 
T = 0.1. 
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%sig05p_01 .m 

ws=[2*pi 818*pi 22*pi] ; 

P=1; ts=0.001; |t=[|^:P]; T-0.1* ?Hef»5sfe«(P/T); 

n=[0:T/ts:length(tt)]; n=n(l:N); nT=n*ts; k=[0:N-l]; 

xlt= cos(ws(1)*tt)+cos(ws(2)*tt); xlji,=; xlt ; Xl= fft (xln) ; 

subplat (521) „ plot (tt, xlt) , hold a*iW:'(gem (nT, xln,' .' ) 

subplot(522), stem(k,abs (XI),'.') 


(f) Among the sampling rates {15Hz, 20Hz, 25Hz, 40Hz, 50Hz}, choose the 
lowest one such that the frequency aliasing does not occur for any of (a)-(d). 

5.2 Reconstruction 

Consider the continuous-time waveform x(t) depicted in Fig. P5.2. 



-i o 1 


Fig. P5.2 


(a) Use Eq. (E2.3.4) to find the CTFT of x(t). 

(b) Regarding x(t ) as a periodic waveform with period P = 2 [s], we can 
sample it with sampling period T = 0.5 [s] to get a (non-causal) discrete¬ 
time sequence 

x N c W = "{ 0.5, 1, 0.5, 0 } (P5.2.1) 

and take the part of the periodic repetition of xjvcM with period N = 4 
for n = 0 : 3 to have a causal sequence 

x[n]=Tl, 0.5, 0, 05} (P5.2.2) 

Find the 4-point DFT of this sequence. 

(c) Find the analytical expression of the DFS reconstruction of x(t ) using the 
DFT obtained in (b) and plot it on Fig. P5.2. 

(d) Suppose we can apply an ideal LPF for reconstruction. Can the waveform 
depicted in P5.2 be reconstructed perfectly from its sampled version with 
some sampling period? Say ‘yes’ or ‘no’ and state the background of your 
answer. 
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5.3 Discrete-Time Interpolation 

Consider the discrete-time signal x[n] whose DTFT spectrum is depicted in 
Fig. P5.3. 

(a) Sketch the spectrum of y[ri] = x @)[«] where 


r r \x[n/ 2] for n = 2m(m : integer) 

y[n] = x ( 2 )[n] = • 

0 elsewhere 


(P5.3.1) 


(b) Suppose that we wish to form an interpolated version of x[n\ by passing 
y\n\ through a lowpass filter. Specify the requirements of the LPF on its 
gain and bandwidth. 



Fig. P5.3 

5.4 Discrete-Time Interpolation 

Consider the discrete-time signal x[n\ obtained by sampling the following 
continuous-time signal x(t ) at t — nT(n = 0 : 50, T = 0.0001 sec) with 
sampling rate F s = 10kHz.: 

x(t) = cos(2;r x 1000?) + sin(27r x 3000?) (P5.4.1) 

Using the discrete-time interpolation introduced in Sect. 5.4.4, insert 19 points 
between successive sample points of x\ri] to make a 1020-point interpolation 
i>[n] and plot it (continuously in a solid line) together with x(nT ) (discretely 
using the ‘x’ mark). 

5.5 A/D- G[z ] (digital filter)-D/A Structure 

Consider the A/D- G[z] -D/A structure with G[z] = 1 + z -1 where the input is 
to be sampled with sampling period T = 0.1 [s]. 

(a) Let the input be given by Xi(?) = sin( 1 Ozr?/3). What is the digital frequency 
of x\[ri] = xi(nT)l 

(b) What is the highest analog frequency such that the input signal will not be 
aliased? 

(c) Find the frequency response and DC gain of the digital filter G[z]. 

(d) Find the steady-state output yi, ss [n] to x\[n] = x\(nT) = sin(10jrrn/3). 

(e) Find the steady-state output >’2, iSiS [n] to the unit step input X2M = u s \ri\. 

(f) Support your answers to (d) and (e) by the simulations for n = 0 : 50. 
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In this chapter we are concerned how continuous-time and discrete-time systems 
are or can be related with each other. We will discuss the concept and criterion 
of discrete-time equivalent (digital simulator) and investigate various discretization 
methods to obtain the discrete-time equivalent for a given analog system, which can 
be used for the analysis and design of sampled-data systems. 


6.1 Concept of Discrete-Time Equivalent 

As the technology of digital processors becomes more advanced, it is often desirable 
to replace analog systems with digital ones. In some cases, we need to transform 
the analog systems into their “equivalent” digital systems in order to simulate their 
behaviors on digital computers. In other cases, rather than designing directly a 
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digital system, we make use of a variety of well-developed analog system design 
procedures to get an analog system with satisfactory performance and then convert 
it into a discrete-time equivalent that mimicks (emulates) the analog system. In 
either case, for a given continuous-time linear time-invariant (LTI) system G A (s) 
with input x(t) and output y A {t), we wish to find a discrete-time system Gd\z\ with 
input x\n] and output y«[n] such that 

x[n] = x(nT) =» y D [n] = y A (nT ) (6.1.1) 

This means that G A (s) and G D \z\ yield the equivalent outputs to equivalent inputs 
in the discrete-time domain. We will call such a system Gd\z\ the discrete-time 
(z-domain) equivalent or digital simulator for G a (s ) where Eq. (6.1.1) is referred 
to as the ( discrete-time ) equivalence criterion. To establish necessary conditions for 
the validity of the above criterion, we shall first consider sinusoidal inputs, which 
will lead to the general case, because an arbitrary signal can be expressed as a linear 
combination of sine waves (the Fourier series representation). Suppose the input 
x[n] of a discrete-time system Gd\z\ is the discrete-time version of x(t) = e' rM 
sampled with period T, i.e., x[n] = x(nT) = e' nwT where x(t) is the input to the 
continuous-time system G A (s) (see Fig. 6.1): 

x(t) = e J0>t Sam P lm g Wlth P enod T > *[„] = x ( nT ) _ e Jna>T ( 6 . 1 . 2 ) 


Then we can use the convolutional input-output relationships (1.2.4)/(1.2.9) of 
continuous-time/discrete-time LTI systems and the definitions of CTFT and DTFT 
to write the outputs of G A (s) and Gd\z] as 


3U(0 = f°° gA{T)e jm(, - r) dx ? y D [n] = J]" = _ oo g D me^ n - m)T 

G A Uo»e SamPlingWIthpi ° d J ( = !) Gol^je^T 

(6.1.3) 

where 

G A (jco) (2 '= U> [ g A (j)e~ J<or dT * = ’ G A (s)\ s ^ f(a (6.1.4a) 
J -oo gA (r)=0Vr<0 

causal system 

G fl [ e M] (3 iY” g D [m]e- jmmT (4 '= b) G n [z]\ 7=eJ „, (6.1.4b) 

*—‘m =-oo g D [n]=0Vn<0 


x(t)=ei ut 



G a (s) | -- y A (t)=G A (ju)ei“ T 

G p [z] - Jk§>[n]= G D [el uT ]ei nu 


y A (nT) l y D [n] 


Fig. 6.1 The equivalence criterion between a continuous-time system and a discrete-time system 
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The above equivalence criterion (6.1.1) can be stated in terms of the frequency 
responses of the continuous-time and discrete-time systems as 


G D [e^ T ] = G A (jco) (6.1.5) 


This is referred to as the frequency-domain discrete-time equivalence criterion. 

However, this equivalence criterion cannot be satisfied perfectly because the 
digital frequency response Go[e 7 ® r ] is periodic in w (Sect. 3.2.1) while the fre¬ 
quency response GaUco) is not. This implies that we cannot find the discrete-time 
equivalent of a continuous-time system that would work for all kinds of inputs. In 
principle, the criterion (6.1.5) can be satisfied only for the principal frequency range 
(—n/T, +n/T) if we restrict the class of inputs into band-limited signals that do not 
contain frequencies higher than the folding frequency n/T, i.e., half the sampling 
frequency co s = 2n/T. In this sense, the resulting system Go\z] satisfying the 
criterion (6.1.5) is a discrete-time equivalent of Ga(s), which is valid only for such 
band-limited input signals. 


Remark 6.1 Equivalence Criterion and Band-Limitedness Condition 

(1) The band-limitedness condition is not so restrictive since we can increase n/T 
by decreasing the sampling period T. Furthermore, the condition is desirable in 
order for the sampled output y(nT ) to represent y(t) faithfully. 

(2) As a matter of fact, the equivalence criterion (6.1.5) cannot be met exactly 
even for the principal frequency range since Go\e' ,oT ] is a rational function of 
e'" ,T , while G A (joj) is a rational function of jco. For engineering applications, 
however, approximate equality is good enough. 


Now we will discuss the time-sampling method, which determines Ga[z] so as 
to satisfy the criterion (6.1.5) with reasonable accuracy for almost every co in the 
frequency band of the input signal. The basic idea is as follows. Suppose that the 
input x(t ) and the impulse response g A (t) of the analog (or continuous-time) system 
Ga(s) are sufficiently smooth, i.e., nearly Constantin any interval of length T. Then, 
letting 


gD[n] = T g A (nT) 


satisfies approximately the equivalence criterion (6.1.1), i.e., 


( 6 . 1 . 6 ) 


;yoM = Ta(«T) for x[n]=x(nT) 


since we have 
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y A (nT) a = 4) [ g A (z)x(t - T)dr\ 

J-OO \t-nT 

= YZ=-oo TgA(nT)X(jlT ~ mT) (6 ’ L7a) 

y D [n] °= 9) EL. S D [m]x[n - m ] (6.1.7b) 

The condition (6.1.6) can be written in terms of the transforms as 

G d [z ] = TZ{g A (nT)} = TZ [C~ x {G A {s)}\ t=nT ] (6.1.8) 


Remark 6.2 Time-Sampling Method - Impulse-Invariant Transformation 

Note that sampling the continuous-time unit impulse 8(t ) = (1 /T)sinc(?/T) 
(Eq. (1.1.33a)) at t = nT (i.e., every T s) yields (l/r)sinc(n) 0 = 5) (l/7’)5[n]. 
Then, it is very natural that, in order for G A and Go to be similar, their responses to 
8{t) and (1 /T)8[n] should be the same, i.e., 

g A (nT ) = G A {8m,=nT P G d j ^8[n] } = ^G D {5[n]} = i g D [n ] (6.1.9) 


where G{x(t)} denotes the output of a system G to an input x(t). This is equivalent 
to the condition (6.1.6) for the impulse-invariant transformation. 


Remark 6.3 Frequency Response Aspect of Impulse-Invariant Transformation 
If G A {jco) is negligible for \co\ > n/T (in agreement with the smoothness 
conditions about g A (t)), then we can take the DTFT of (6.1.6) and use Eq. (3.5.7) 
or (5.3.1b) to get 


(5.3.1b) 

G D (S2)= ng D [n]}\n=<oT = Tf(gA(nT)} = G A (co) (6.1.10) 


6.2 Input-Invariant Transformation 

We will consider the input-invariant transformations that are error-free for specific 
input signals. For example, the impulse-invariant/step-invariant transformation is 
accurate when the input is an impulse or a step function. If they were accurate 
only for the specified inputs, they would be of limited practical value. However, 
by superposition, an input-invariant transformation gives zero error in response to 
any linear combination of specified input functions. 
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6.2.1 Impulse-Invariant Transformation 

As mentioned in Remark 6.2, this is identical to the time-sampling method discussed 
in the previous section. Note that Eq. (6.1.8) can be written as 

Z~ X {©DM • = $THGa(s) ■ 1 )|,=„T 

g D [n ] * ^S[n] (1 = 8) jg D [n] = g A (t)\ t=nT ° = ° g A {t ) * 8{t)\,=nT (6.2.1) 

This implies that the (impulse) response of the continuous-time system G A (s) to the 
impulse input S(t) is equal to the response of the discrete-time system Gd[z\ to the 
input (1 /T)8[ri\, which is the sampled version of 8(t). 

The procedure to derive the impulse-invariant equivalent G lmp [z] for a given 
analog system G A (s) is as follows: 

1. Expand G A (s) into the partial fraction form: 

G a (s) = T N , ( 6 . 2 . 2 ) 

*—'1 =1 s - Si 

2. Replace each term l/(s - s,) by T /(l - e s ‘ T z~ l ): 

G,.„4d = E", t ffzF' <6 2 ' 3) 

Remark 6.4 Mapping of Stability Region by Impulse-Invariant Transformation 
Comparing Eq. (6.2.2) with Eq. (6.2.3), we observe that a pole at s = Sj in 
the s-plane is mapped to z = e SiT in the z-plane. Consequently, if and only if s, 
is in the left half plane (LHP), which is the stable region in the s-plane, then the 
corresponding pole is inside the unit circle, which is the stable region in the z-plane 
(see Fig. 6.2). However, the zeros will not in general be mapped in the same way as 
the poles are mapped. 



Fig. 6.2 Mapping of poles from the 5-plane to the z-plai 
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Remark 6.5 Frequency Transformation by Impulse-Invariant Transformation 

The relationship between the analog frequency coa and the corresponding digital 
frequency Q is linear, that is, £2 = coaT since 



evaluation along the unit circle evaluation along the Joja —axis 


Consequently, the shape of the frequency response is preserved. The negative aspect 
of this linear frequency relationship is that short sampling period T does not remove 
the frequency-aliasing problem caused by the impulse-invariant transformation (see 
Fig. 6.8). 

Example 6.1 Impulse-Invariant Transformation - Time-Sampling Method 

For a continuous-time system with the system function Ga(s) and frequency 
response G A (y co) as 


G a (s) =-; Ga(Jco) =- (E6.1.1) 

s + a jco + a 

the impulse-invariant transformation yields the following discrete system function 

(6.2.3) a T - r aT 

Gimp[z\ = - -f — t; G imp [e J ] = - ——— (E6.1.2) 

1 —e~ al z~ l \ - e~ al e-i® 1 


6.2.2 Step-Invariant Transformation 

If we let 

G step [z\ = (1 - z~ x )Z { Cr x { ^G A (s) J | J (6.2.5) 

then it will be an exact discrete-time equivalent of G A (s) for any input composed of 
step functions occurring at sample points. Note that Eq. (6.2.5) can be written as 


gstepW * U s [n\ = g A {t ) * U s (t)\ t=nT (6.2.6) 


This implies that the step response of the continuous-time system G A (s) is equal to 
the step response of the discrete-time system G step [z] on a sample-by-sample basis. 
That is why Eq. (6.2.5) is called the step-invariant transformation. 

Let us consider the discrete-time error model for Ga(s) and G step \z\ in Fig. 6.3, 
in which the input to Ga(s) is x(t), i.e., the zero-order-hold version of x(t). The 
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Fig. 6.3 The discrete-time error model for the step-invariant transformation 


discrete-time transfer function of the system with a z.o.h. in the upper part of 
Fig. 6.3 is 

Z{C~ l {G„oMG A (s)}| t=nJ ,} (5 = 15) Z {/T 1 | 1- J TS GaC?) j | J 

= (1 - Z~ 1 )Z j CT X j -^Ga(s) J | J (6 i 5) G step [z ] (6.2.7) 


Therefore the step-invariant transformation is also called the zero-order-hold equiv¬ 
alent mapping and it is well suited to a digital computer implementation in the 
A/D-G[z]-D/A structure. 

Example 6.2 Step-Invariant Transformation (Zero-Order-Hold Equivalent) 

For a continuous-time system with the system function 


- with a pole at s = s p = —a 


(E6.2.1) 


the step-invariant transformation yields the following discrete system function: 


Z 


B.8(3),(6) 1 

1 -z- 1 

G s tep\.Z] (6 = 5) (1 — Z~ l )Z 


1 — e~ aT z~ l 

J ^Ga(s) j = 


_ (1 - e~ aT z~ l ) - (1 - z" 1 ) 

(1 — z -1 )(l — e~ aT z~ l ) 

1 - e~ aT 

z _ e _ aT = G zoh [z] (E6.2.2) 


This imphes that the s-plane pole is mapped into the z-plane through the step- 
invariant transformation in the same way as through the impulse-invariant trans¬ 
formation. 


s = s p = -a 


z = z p = e 


= e~ 
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6.3 Various Discretization Methods [P-1] 


A continuous-time LTI system can be described by the system or transfer function 


where X(s) and Y (s) are the Laplace transforms of the input and output. Its input- 
output relationship can be written as an integro-differential equation. We often use 
the numerical methods to convert the integro-differential equation into the corre¬ 
sponding difference equation, which can easily be solved on a digital computer. 
The difference equation may be represented by a discrete system function Gn[z] 
(Sect. 4.4), which can be thought of representing a discrete-time equivalent to G A (s) 
(see Fig. 6.4). 


Continuous-time system Discrete-time system 



Fig. 6.4 Discretization and numerical approximation 


Some numerical approximation techniques on differentiation/integration will 
now be presented with the corresponding discretization methods. 


6.3.1 Backward Difference Rule on Numerical Differentiation 

We could replace the derivative of a function x(t) 

| (t) = x(t ): Y(s) = s X(s ) 


by 


where the initial values have been neglected since we are focusing on describing 
the input-output relationship. This numerical differentiation method suggests the 
backward difference mapping rule (Fig. 6.5(a)): 


s 


l-z- 1 

T 


or equivalently, 


1 -sT 


(6.3.1) 






Example 6.3 Backward Difference Rule 

For a continuous-time system with the system function G A (s) = a/(s + a), the 
backward difference rule yields the following discrete system function: 


aTz/(l+aT) 

s — 1/(1 +aT) 


This implies that the s-plane pole is mapped into the z-plane through the backward 
difference or right-side integration rule as 


This implies that if the s-plane pole s p is so close to the origin and/or the sampling 
period is so short that \s p T\ « 1, then the location of the pole mapped to the 
z-plane from the s-plane is 


This relationship between the s-plane poles and the corresponding z-plane poles is 
almost the same as those for other discretization methods. 

Remark 6.6 Mapping of Stability Region and Frequency Transformation 

From Eq. (6.3.1), it can be seen that the y'cu-axis (the stability boundary) in the 
s-plane is mapped to 


1 



1 — jcoT + 1 + jcoT 
2(1 - jcoT) 


^(1 + e je ) with 9 = 2tan 1 


(coT) 

(6.3.2) 


This describes the circle of radius 1/2 and with the center at z = 1/2, which is 
inside the unit circle in the z-plane (see Fig. 6.5(c)). It is implied that the backward 
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difference rule always maps stable analog systems into stable discrete equivalents, 
but some unstable analog systems also yield stable discrete ones. Besides, since the 
y co-axis in the s -plane does not map to the unit circle in the z-plane, the digital 
frequency response will deviate from the analog frequency response as w —> ±oo 
or £2 —» ±7 x (farther from s = 0 or z = 1). Thus, in order to make the frequency 
response of the discrete-time equivalent close to that of the original analog system 
(for the principal frequency range), we must decrease the sampling T or equiva¬ 
lently, increase the sampling frequency co s so that significant pole/zeros are mapped 
to the neighborhood of z = 1 ■ 


6.3.2 Forward Difference Rule on Numerical Differentiation 

We could replace the derivative of a function x(t) 


y(t ) = -7- x(t ): Y(s) = s X(s) 


This numerical differentiation method suggests the forward difference mapping rule 
(Fig. 6.6(a)): 


s 


z- 1 

Th¬ 


or equivalently, I + s f 


(6.3.3) 


Example 6.4 Forward Difference Rule 

For a continuous-time system with the system function Ga(s) = a/(s + a), the 
forward difference rule yields the following discrete system function: 



(a) Forward difference rule (b) Left-side integration rule (c) Mapping of stable region 


Fig. 6.6 Forward difference or left-side integration rule 
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This implies that the s-plane pole is mapped into the z-plane through the forward 
difference or left-side integration rule as 

(6 3 3) ( D -25) 

s = s p = —a z = z p = 1+ s„T = e SpT (E6.4.2) 

for |3f J ,r|<;<3 

This implies that if the s-plane pole s p is so close to the origin and/or the sampling 
period is so short that |s p T| << 1, then the location of the poles mapped to the 
z-plane from the s-plane is 


Remark 6.7 Mapping of Stability Region By Forward Difference Rule 

From Eq. (6.3.3), it can be seen that the y co-axis (the stability boundary) in the 
s-plane is mapped to 


z = 1 + jcoT (6.3.4) 

This describes the straight line parallel to the imaginary axis and crossing the real 
axis at z = 1. It is implied that the forward difference rule maps the left half 
plane (LHP) in the s-plane to the left of z = 1 in the z-plane with some por¬ 
tion outside the unit circle. Consequently, some stable analog systems may yield 
unstable discrete equivalents, while unstable analog systems always make unsta¬ 
ble discrete ones. Hence, this is an undesirable mapping that cannot be used in 
practice. 


6.3.3 Left-Side (Rectangular) Rule on Numerical Integration 

We could replace the integral of a function x(t ) 

y(t) = f x{x)dx : F(s) = -XOs) 

Jo s 

^ y(nT) = y(nT — T) + TxtnT - T) : Y[z] = 

This numerical integration method suggests the left-side integration rule 
(Fig. 6.6(b)): 

s ~y~ or equivalently, 1 + s T —»• z (6.3.5) 


This is identical to the forward difference rule (6.3.3). 
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6.3.4 Right-Side (Rectangular) Rule on Numerical Integration 

We could replace the integral of a function x(t) 

y(t) = J x(r)dr : Y(s ) = ^X(s) 

y{nT) = ytfiT — T) + T x{nT ): Y[z] = ^X[z] 

This numerical integration method suggests the right-side integration rule 
(Fig. 6.5(b)): 

1 — z. i 1 

s —> ——— or equivalently, - -— —z (6.3.6) 

This is identical to the backward difference rule (6.3.1). 


6.3.5 Bilinear Transformation (BLT) - Trapezoidal Rule 
on Numerical Integration 

By the trapezoidal rule (or Tustin’s method), we could replace the integral of a 
function x(t) 

y{t) = [ x{x)dr : T(s) = -X(i) 

Jo s 

by T T \ +z~ l 

y{nT) = y{nT -T)+ ~{x{nT) + x(nT - T )): Y[z] = - —~^ x [z] 

which suggests the bilinear transformation rule (Fig. 6.7(a)): 

s —> -, or equivalently, S — -> z (6.3.7) 

T l+z- 1 1 — sT/2 


y(t)=f 0 x{r)dT 

-> y(nT)=y(nT-T) +I(x(nT) + x(nT-T)) 



(■ n-1)T m (h+1) T 
(a) Trapezoidal integration rule 



(b) Mapping of stable region 


Fig. 6.7 Trapezoidal integration rule or Tustin’s method - Bilinear transformation 
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Example 6.5 Bilinear Transformation (BLT) 

For a continuous-time system with the system function Ga($) = a/(s+a) having 
a pole at s = —a and cutoff frequency coa, c = «, the bilinear transformation (BLT) 
yields the following discrete system function: 



a 


2(1 ; ') 

iffer 1 ) 


a 


aT{z + l)/(2 + aT) 

_ l-ar/2 

4 TiSSU': 


(E6.5.1) 


This implies that the s-plane pole is mapped into the z-plane through the BLT 


(63.7) l+S p T/2 _ 
s -s p - a -* z-Zp 1 _ SpT /2 - 

/ e s P T/2 \ 

(= = eSpT f °rivn«ij 


1 — aT /2 
1 +aT/2 


(E6.5.2) 


The cutoff frequency of this discrete-time equivalent can be found 


\Gbl[z]\\ z = e j(oT 


J2 



(E6.5.3) 


Remark 6.8 Mapping of Stability Region and Frequency Transformation by BLT 
From Eq. (6.3.7), it can be seen that the jco -axis (the stability boundary) in the 
s-plane is mapped to 


(63.7) l+j(oT/2 
Z s=ja> 1 - j(oT/2 


y/l 2 + {coT/2? 
yi 2 + (wT/ 2) 2 


(«an-'(f)- M -'(=f)) 


_ e j2tm(a>T/2) 


= el Q 


(6.3.8) 


which describes the unit circle itself (see Fig. 6.7(b)). It is implied that the BLT 
always maps stable/unstable analog systems into stable/unstable discrete-time equiv¬ 
alents. However, since the entire jco -axis in the s-plane maps exactly once onto the 
unit circle in the z-plane, the digital frequency response will be distorted (warped) 
from the analog frequency response while no frequency aliasing occurs in the fre¬ 
quency response, i.e., the analog frequency response in the high frequency range 
is not wrapped up into the digital frequency response in the low frequency (see 
Fig. 6.8). We set z = e JCi = e* WDT with £2 = oo D T in Eq. (6.3.8) to get the 




6.3 Various Discretization Methods [P-1] 


291 


For low frequencies such that |o>aI << 1 —> tan 1 (oj a T /2) = co A T /2, this 
relationship collapses down to 


(6.3.10) 


On the other hand, the nonlinear compression for high frequencies is more apparent, 
causing the frequency response at high frequencies to be highly distorted through 
the bilinear transformation. 

Remark 6.9 Prewarping 

(1) To compensate for the frequency warping so that frequency characteristics of 
the discrete-time equivalent in the frequency range of interest is reasonably 
similar to those of the continuous-time system, we should prewarp the critical 
frequencies before applying the BLT, by 


- tan 


(<o a T\ 


: prewarping 


o that frequency transformation (6.3.9) with prewarping becomes 
co'd <6 = 9) \ tan" 1 (= a>A 


(2) The BLT with prewarping at an analog frequency co c can be performed by 
substituting 


2 1 -z 1 w a) c co c 1-z" 1 

T 1 +Z- 1 X (2/T)tan(« c r/2) ~~ tan(« e T/2) 1 + z" 1 


instead of s 


2 1-z" 1 

T 1+Z- 1 


(6.3.13) 


for s in G A (s) where co c (< n/T ) is a critical (prewarp) frequency. 

(3) The warping and prewarping (against warping) by the frequency scale conver¬ 
sion is depicted in Fig. 6.8. It is implied that, if we design an analog filter, 
i.e., determine G A (joJ A ) to satisfy the specifications on frequency a / A , the orig¬ 
inal frequency response specifications on oj a will be satisfied by the digital filter 
Gw[z] that is to be obtained by applying the BLT to G A (s r ). 

Figure 6.8 show the frequency transformation through BLT (accompanied with 
frequency warping, but no frequency abasing) and that through impulse-invariant 
transformation (accompanied with frequency aliasing, but no frequency warping). 
Example 6.6 Bilinear Transformation with Prewarping 

For a continuous-time system with the system function Ga(s ) = a/(s+a) having 
a pole at s = — a and cutoff frequency co A , c = a, the bilinear transformation (BLT) 
with prewarping yields the following discrete system function: 




6.3.6 Pole-Zero Mapping - Matched z-Transform [F-l] 

This technique consists of a set of heuristic rules given below. 

(1) All poles and all finite zeros of G a(s) are mapped according to z = e sT . 

(2) All zeros of G a(s) at s = oo are mapped to the point z — — 1 in G[z]. (Note 
that s = j oo and z = — 1 = e jn represent the highest frequency in the s -plane 
and in the z-plane, respectively.) 

(3) If a unit delay in the digital system is desired for any reason (e.g., because of 
computation time needed to process each sample), one zero of Ga($) at s = oo 
is mapped into z = oo so that G[z] is proper, that is, the order of the numerator 
is less than that of the denominator. 

(4) The DC gain of G pz [z] at z = 1 is chosen to match the DC gain of G A (s) at 
s = 0 so that 

Golzl p G a (s)| j=>a=0 ; G pz [ 1] = Ga( 0) 

Example 6. 7 Pole-Zero Mapping 

For a continuous-time system with the system function G A (s) = a/(s + a), we 

can apply the pole-zero mapping procedure as 


a zero at s = oo Rule l, 2 zero at z = — 1 z + 1 
a pole at s = -a pole at z = e~ aT z - e ~ a 



(E6.7.1) 
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At the last stage, (1— e~ aT ) is multiplied so that the DC gain is the same as that of the 
analog system: G pz [ 1] = G^(0) = 1. This happens to be identical with Eq. (E6.2.2), 
which is obtained through the step-invariant (or z.o.h. equivalent) transformation. 

Remark 6.10 DC Gain Adjustment 

Irrespective of which transformation method is used, we often adjust the DC gain 
of G[z] by multiplying a scaling factor to match the DC steady-state 
response: 

G d [z]\^.,t = 1 = G A (s)\ s=jlOA=0 - G pz [l] = G A (0) (6.3.14) 


6.3.7 Transport Delay - Dead Time 

If an analog system contains a pure delay of d s in time, it can be represented by a 
continuous-time model of the form 

G(s) = H(s)e~ sd (6.3.15) 

If the time delay is an integer multiple of the sampling period T, say, d = MT, 
then the delay factor e~ sd = e~ sMT can be mapped to z~ M (with M poles at z = 
0). More generally, if we have d = MT + d\ with 0 < d\ < T, then we can 
write 

e~ sd = e~ sMT e~ sd ' (6.3.16) 

With sufficiently high sampling rate such that d\ < T << 1, we can make a rational 
approximation of 


e - di s ~ 1 - d\s/2 

1 -(- d\s /2 


(6.3.17) 


Now we can substitute Eq. (6.3.16) with Eq. (6.3.17) into Eq. (6.3.15) and apply a 
discretization method to obtain the discrete-time equivalent. 


6.4 Time and Frequency Responses 
of Discrete-Time Equivalents 

In the previous section we have obtained several discrete-time equivalents for the 
continuous-time system G A (s) = a/(s+a). Figure 6.9(al, a2, bl, and b2) show the 
time and frequency responses of the two discrete-time equivalents obtained by the 
z.o.h. mapping and BLT for the sampling period of T = 0.5 and T = 0.1 [s] where 
a = 1. The following program “sig06f09.m” can be used to get Figs. 6.9(al) and 
(bl). 
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Note the following: 

- All the discrete-time equivalents have the frequency characteristics that are peri¬ 
odic with period 2n in the digital frequency £2 or with period In/T in the analog 
frequency cod = Q/T and become similar to that of the continuous-time system 
for wider frequency range as the sampling period T gets shorter. 

- The BLT gives a zero at cod = n/T corresponding to the zero at z = — 1 = e jn , 
assuring no aliasing problem in the frequency response. 
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- The BLT with prewarping gives the half-power (3dB) frequency at co D = a just 
like the continuous-time system. 


%sig06f09.m 

# .Contiiiueus-it^'pi^CEet-e-time conversion, bt GA(s) =a/ (>Sf:S£) with 
clear, elf 

a :; B=1; A=[l a]; GAs=tf (B, A) ; % Analog transfer function 
t_f=5; tt= [0:0.01:t_f ] ; % Time vector 

'^^•[0 : 0. OQ.jiji ]; wD=2*pr^^|'^^Mital/Analog frequency vector in 

% Sampling period 

fA=fD/T; wA=wD/T; % Digital/Analog frequency vector in rad/s 
GAw.maq--- abs (f reqs (B, A, wA) ) ; % Analog- ff-egusSvcy reponse |GA(jw) | 
GD_zoh=c2d (GAs, T, ' zoh' ) ; [Bd_zoh, Ad.zoh] =tfdata (GD.zoh, ' v' ) 
GD_BLTp=c2d(GAs,T, 'prewarp' , a) ; [Bd_BLTp, Ad_BLTp] = tfdata (GD_BLTp,' v' ) 
[yt, t] “step (GAs, t_f ).J- % Step respshse 
N-t2-S5frf nT= [0 :N-1] yn„zoh=dstep (Bd,»c!h,Ad_zoh,N) ; 
subplot (411) , plot(t,yt), hold on, stairs (nT, yn.zoh,':') 
GDw_zoh_mag=abs (freqz (Bd_zoh, Ad.zoh, wD) ) ; % Digital frequency response 
subplot (413) , - jjpiot (fD, GAw_mag, fp> G&W-zohjnag,' :' ) 


6.5 Relationship Between s -Plane Poles 
and z-Plane Poles 


In this section, we will derive the mathematical relationship between the s-plane and 
z-plane pole locations. We write the system function of a continuous-time second- 
order system in standard form as 


0 + a) 2 + a 


m<i 


which has the poles at 


ii ,2 = ± j w„V 1 - K 2 = -cr ±j cod (Fig. 6.10(a)) 



Fig. 6.10 Pole locations and the corresponding impulse responses 
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where £, a, co n , and co d are the damping ratio, damping constant, natural frequency, 
and damped frequency. Note that the impulse response of the system is 


g{t) = C 1 {G(s)} =fg===#^sin(ft) d t) (Fig. 6.10(b)) 

The z-plane poles corresponding to the ,v-plane poles s 1,2 are located at 
zi i i=e sT \ s ^= e~ aT Z ± co d T = rZ ± £2 

where 

e ia> '‘ T = e~ aT = r or t;co n T = oT = — In r 
and co n T-J\ — t, 2 = co d T = £2 : digital frequency 

The discrete-time version of the impulse response can be written as 

g[n] = g(nT) (6 '= 2) -j==e~ aTn sin (c o d Tn ) 


(6.5.4a) 

(6.5.4b) 


Note that the larger the distance r of a pole from the origin is, the slower the output 
stemming from the pole converges; on the other hand, the larger the phase £2 (digital 
frequency) of a pole is, the shorter the discrete-time oscillation period of the output 
stemming from the pole £2 is. 

Based on Eqs. (6.5.4a) and (6.5.4b), we can express the dampling ratio f and 
natural frequency co„ in terms of the parameters of the pole location, i.e., the absolute 
value r and phase £2 of the pole(s) as 


£ 



— In r ^ -In r 

a ; c = 5P7+F 


w„ = ^Vln 2 r + £2 2 


(6.5.6) 

(6.5.7) 


The time constant of the pole(s) is 


_ 1 _ 1 

T er ?<w„ 


—T 

hT7 


(6.5.8) 


Thus, given the complex pole locations z = rZ ± £2 in the z-plane, we can find the 
damping ratio t;, natural frequency co n , and time constant r. If we have sufficiently 
high sampling rate so that T < < r, the poles of the discrete-time system are placed 
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Fig. 6.11 The loci of the poles of a digital system for f = constant, u>„T = constant, and o>,iT = 
constant 


in the vicinity of z = 1. Note that high sampling rate does not make the response 
slower, but only makes the sampling interval shorter. 

Figure 6.11 gives a picture of how the s-plane and z-plane poles are related where 
the loci of pole locations for constant damping ratio £ are logarithmic spirals (with 
decreasing amplitude r — e~^ ( ° nT as co„T increases) and the loci of pole locations 
for constant co„T are drawn at right angles to the spirals for £ = constant. 


6.6 The Starred Transform and Pulse Transfer Function 
6.6.1 The Starred Transform 

We define the starred transform X. t (s) of a signal x(t) to be the Laplace transform 
of the impulse-modulated version x*(t) = x(t)Sr(t) representing the output signal 
of an ideal sampler with sampling period T. Using Eq. (2.1.10), we can express the 
ideal sampler output as 


x(t)S T (t) = ~ x ^ el k0>s ' with Ws = “ 


Taking the Laplace transform of the both sides and using the complex translation 
property (Table B.7(3)), we obtain the bilateral starred transform of x(t) as 


= j E - j kc °s) X(s + j ***> 


( 6 . 6 . 2 ) 
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Also, from Appendix III of [P-1], we borrow the following expressions for the 
unilateral starred transform: 


X*Cs) = J2 x(mT ) e~ mTs = X[z]\ z=e r, (6.6.3a) 

X*(.v) = y £ X ( s + J ka >*) x(jlT) e ~" TS (6.6.3b) 

1 k=-oo n =0 

where A x(nT) = x(nT + ) — x{nT~) is the amplitude of the discontinuity of x(t) at 
t = nT. 

The bilateral and unilateral starred transforms have the following properties: 
<Properties of the starred transform> 

1. They are periodic with period of jco s in s: 

X*(s + jmcos) = ^r(nf) e -nT(s+jmw,) _ ^ ~^x(nT ) e~ nTs = X*(,s) (6.6.4) 

since e -i" m< °s T — e -jnm2n _ i f or an y integer m. 

2. If they have a pole at s = s\, then they will also have poles at $ = ,v i + 
jma> s , m = 0, ±1, ±2, • • •: 

X*(s) = ^ {X(s) + X(s + jco s ) + X(s - jco s ) + X(s + j2w s ) + X(s - j2co s ) + ■■■ 

(6.6.5) 

6.6.2 The Pulse Transfer Function 

Consider the sampled-data systems depicted in Fig. 6.12 where the one has a sam¬ 
pled input and the other has a continuous-time input. Under the assumption of zero 
initial conditions, the output transform of system (a) can be written as 

Y(s) = GCs)X*(s) (6.6.6) 

If x(t) and y(t) are continuous at all sampling instants, we can use Eq. (6.6.2) to 
take the starred transform of Eq. (6.6.6) as 


x(t) 

X(s) 




X.(Q 

x*(s) 


•\ G(s) f- 


m 

X(s) 


] G(s) [ 


c^o 

m 


y*m 

n(s) 


r*(f) 

>*(S) 


Fig. 6.12 Sampled-data 
systems 
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F*Cs) (6 = 6) {G(s)X*(s)}* (6 = 2) j G(s + jkco s )X*(s + jkco s ) 

<6 = 4> ^ G(s + v *(«) = G*(s)X*(s) (6.6.7) 

where G*(s) is called the pulse transfer function. This implies that, when taking the 
starred transform, we can factor out the existing starred transform. If we replace e Ts 
by z in the starred transform, we will get the z-transform 

Y [z] = G (z) X [z] (6.6.8) 

which describes the input-output relationship in the z-domain. 

In contrast with this, the sampled output of system (b) in Fig. 6.12 can be 
expressed as 


y*(s) = (G(s)X(s)}* + G*(s)X*(s) (6.6.9a) 

Y[z] = GX[z] ± G[z]X[z] (6.6.9b) 

This implies that, if the input is applied to a continuous-time system before being 
sampled, the input transform can never be factored out to derive the transfer 
function. 


6.6.3 Transfer Function of Cascaded Sampled-Data System 

Consider the cascaded sampled-data systems depicted in Fig. 6.13. Each of the three 
sampled-data systems has the input-output relationship as below: 

(a) y*(j) = {G 2 (s)V,(s)},. (6 = 7) G 2 ,(s)VJs) = G 2 Js)G u (s)XJs) 

Y[z] = G 2 [z]Gi[z]X[z] (6.6.10a) 

(b) r*(5) = {G 2 (5)G!(5)X*(5)}» ^{G^G^)}***^) = GfG~ u (s)X*(s) 

Y[z] = GfGf[z] X[z] (6.6.10b) 

(c) Y t (s) = {G 2 (s)V*(s)h (6 = 7) G 2 *(5)V*W = G 2 *(i){Gi(s)X(i)}* 

= G 2 *(s)GGC(s); Y[z] = G 2 [z]GfX[z ] (6.6.10c) 
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m 


y*(t) 

*Y*(s) 


XJ.s) I “ 1W I V(s) T v. t (s)' \-rmp. \ Y(s) 

\ /(s)=G 1 (s)X*(s) Y(s)=G 2 {s) V*(s) = G^sHGdsJX^s)}* 



J V(s) T 
l/(s)=G 1 (s)X(s) 


Fig. 6.13 Cascaded sampled-data systems 


Y(s)=G 2 (s) V*(s) = G z (s){G,(s)X(s )}* 


6.6.4 Transfer Function of System in A/D-G[z]-D/A Structure 

Consider the sampled-data system containing an A/D-G[z]-D/A structure or a S/H 
device depicted in Fig. 6.14. Both of the two systems (a) and (b) have the same 
transfer function 

V \ Z ] = G ho G 2 [z]Gdz] ( 6 . 6 . 11 ) 

since 

V[z] = Gdz]X[z] ■ V[e Ts ] = G x [e Ts ]X[e Ts ] ■ V,(s) ^,Q u (s)X t (s) 

1 _ e ~Ts ! _ e -Ts 

V(s) = -V*(s) =-Gi*(s)X,Cs) 

5 s 

1 

Y(s ) = G 2 (s)V(s) = - G 2 (s)G l *(s)X*(s) 

s 

Y[z] = zj 1 * G 2 (s)j Gi\z]X[z\ = G^G~ 2 [z] Gdz] X[z] 



Fig. 6.14 Sampled-data system containing an A/D-G[z]-D/A structure or a S/H device 
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where 


G A „G 2 [z] = zj(l - e -^)^y^J=(l - z-')Z j^G 2 (s)j : 
the z.o.h. equivalent of G 2 (,s) 

(cf.) Note that the DAC usually has a data-hold device at its output, which allows 
us to model it as a zero-order-hold device. 


Problems 

6.1 Z.O.H. Equivalent 


(a) Show that the zero-order-hold equivalent of G(s) — 1 /s(s + 1) with 
sampling period T is 


- 1 + e~ T )z +l-e~ T 
(z - l)(z - e~ T ) 


(b) Show that the zero-order-hold equivalent of G(s) = 2/{s 2 ■ 
sampling period T is 


(P6.1.1) 
+ 2) with 


G(s) = 


G zoh [z] = 


2 

(s + l) 2 + 1 ^ 

(1 - e _r (cos T + sin T))z + e~ 2T - e~ T (cos T - sin T ) 
z 2 - 2 z e~ T cos T + e~ 2T 

(P6.1.2) 


(c) Use the following MATLAB statements to find the discrete-time equiva¬ 
lent of analog system (b) through the BLT (bilinear transformation) with 
sampling period T = 0.1 [s] and critical frequency co p = sf2 [rad/s]. 

»B=2; A= [ 1 :‘pp. ] ; . 1; wp-sqrt (2) ; 

»GAs= tf (B, A) ; 

:>5-:Gz_BLT_prewarp= c2d(GAs,T, 'prewarp' ,wp) ; 

» [Bd^BLT.p, Ad_BLT_p] = tfdata (Gz_BLT_prewarp, ' v' ) 


Also support the above results of (a) and (b) by completing and running the 
following MATLAB program “sig06p Ol.m”, which computes the z.o.h. 
equivalents of analog system (a) and (b) with sampling period T = 0.1 [s]. 
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%sig06p_01 .m 
clear, cl#; 

B=1; A= [ 1 1 ip] ; T=0.1; e_T= exp(-T); e_2T= exp(-2*T); 
GAs= tf(B,A); % Analog transfer function 
Gz_zoh= c2d(GAs,T); % z.o.h. equivalent 
[Bd_zoh, Ad-zoh] = tfdata (Gz' v') 

Bd= [ (T-l+e.T) l-e_T-T*e_T] , Ad= [1 -l-e_T e_T] % (P6.1.1) 


(d) Referring to the Simulink block diagram of Fig. P6.1, perform the Simulink 
simulation to obtain the step responses of the analog system (b) and its two 
discrete-time equivalents, one through z.o.h. and one through BLT. 


Ub 

Step 

[Simulink/Sources] 



Discrete Filter 1 


Fig. P6.1 Simulink block diagram for Problem 6.1 



Gi(s) 

G 2 (s) 


x(t) 

1 

V [c " 2 1 

y(t) t 

X(s) 

s+1 

M ^2 [ 

Y(s)' 


Fig. P6.2 

6.2 Step-Invariant Transformation 
Consider the system depicted in Fig. P6.2. 

(a) Find the step-invariant equivalent Gi[z] of G \ (s). 

(b) Find the step-invariant equivalent G 2 [z] of G 2 (s). 

(c) Find the step-invariant equivalent G[z] of Gi(y)G 2 (,s). 

(d) Is it true that G[z] = Gi[z]G 2 [z]? 

6.3 Bilinear Transformation without prewarping or with prewarping 
Consider the second-order analog system whose transfer function is 
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a>hS 2s 

G a{s) = 2 * . = - _ with co b = 2, co p = \ (P6.3.1) 

V- + WbS +(ir p s z + 2s + 1 

Note that the frequency response Ga(joj), its peak frequency, and two 3dB- 
frequencies are 


G A (ja >) = 


jcocob 

(ja>) 2 + jcoco b +a> 2 p 


j2oj 

(1 - co 2 ) + j2co 


-co b + J(o\ + 4 co 2 

(Op = 1, a >3 b,i = ---= — 1 + v2, 

w b + Jco 2 b + 4 co 2 

C03B,u = -2- = 1 + v2 


(P6.3.2) 


(P6.3.3) 


(a) Find the discrete-time equivalent Gd[z] using the BLT with sampling 

period of T = 1 [s] and no prewarping. Also find the peak frequency £2 p 
and lower/upper 3dB frequencies Qihj and of the digital frequency 
response G D [e ia ]. How are they related with w p , (03 B ,i, and You 

can modify and use the MATLAB program “sig06p_03.m” below. 

(b) Find the discrete-time equivalent Gd[z] using the BLT with sampling 
period of T = 1 [s] and prewarping three times, once at u> p = 1, once at 
(03 b,i, and once at (03n.11- Also for each G/j[z], find the peak frequency £2 p 
and lower/upper 3dB frequencies Q3B.1 and B , u of the digital frequency 
response G/)\e jU \ and tell which frequency is closest to the corresponding 
analog frequency in terms of the basic realtionship £2 = wT between the 
analog and digital frequencies. 


%sig06p-03 .m 

Bs?[2 0]; A= [1 2 1]; wp=l; w_3dBl= -1 + sqrt (2) ; w_3dB2= l+sqrt(2); 
GAs= tf(B,A); T=l; % Analog transfer function and sampling period 
Gz= c2d(GAs, T,' tustin'); % BLT without prewarping 
W=[0:0.00001:1]*pi; GDW_mag= abs(freqz(BD / AD / W)); 

[GDW_max, i_peak] = max (GDW_mag) ; Wp= W(i_peak) 
tmp= abs (GDW_mag-GDW_max/sqrt (2) ) ; 

[tmp_3dBl, i_3dBl] = min (tmp (1: i_peak) ) ; 

[tmp_3dB2, i_3dB2] = min (tmp (i_peak+l: end) ) ; 

W_3dBl= W(i_3dBl); W_3dB2= W (i_peak+i_3dB2) ; 


6.4 Pole Locations and Time Responses 

Consider an analog system having the system function G a (s) = 1 /{s 1 + 2s + 5) 
and its two z.o.h. equivalents G ZO h i [z] and G ZO h2[z], each with sampling period 
T = 0.2 and T = 0.1, respectively. 
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(a) The pole/zero plot of G a (s) 




(d) The Scope window showing the simulation results 


Fig. P6.4 Pole/zero plots and Simulink simulation 
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(a) Note that the pole-zero plot of G a (s) is depicted in Fig. P6.4(a). Refer¬ 
ring to the pole/zero plots shown in Fig. P6.4(b), choose the pole locations 
(rZQ) of G Z ohi[z] and G ZO h2[z] from (2) and (3). The digital frequency co n T 
of the output corresponding to pole location (2) is expected to be two times 
as high as that of the output corresponding to pole location (3) in proportion 
to the sampling period T where co n is determined from the pole location of 
the analog system G a (s). Does it mean that the output corresponding to 
pole location (2) oscillates two times as fast as that corresponding to pole 
location (3)? 

(b) Referring to Fig. P6.4(c), perform the Simulink simulation for G a (s), 
G ZO hi[zL and G ZO h2[z] to get the simulation results as Fig. P6.4(d) and 
choose the output waveforms of G a (s), G ZO hi [z] and G ZO h2[z] from (T), (2), 
and (3). 




Fig. P6.5 Pole/zero plots and Simulink simulation 


6.5 Pole Locations and Time Responses 

Consider two analog systems, each having the system function Gj (s) — 1 /0 2 + 
Is + 5) and G2O) = I/O 2 + 0.4s + 4.04), respectively and their z.o.h. 
equivalents G ZO ht[z] and G ZO h2[z] with sampling period T =0.1. 
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(a) Note that the pole-zero plots of G\ (s) and G2(s) are depicted in Fig. P6.5(a). 

Referring to the pole/zero plots shown in Fig. P6.5(b), choose the pole loca¬ 
tions of Gzohitz] and G ZO h2[z] from (3) and 0. Which converges faster of 
the outputs stemming from the poles (3) and 0? Note that the poles (3) are 
closer to the origin than the poles 0, i.e., < u,. 

(b) Referring to Fig. P6.5(c), perform the Simulink simulation for G \ (s), Gjijs}, 
G Z ohi Izl and G ZO h2[z] and choose the output waveforms of the four systems 
from (a), (6), ©, and 0. 

6.6 Pole-Zero Mapping (Matched z-Transform) of an Analog System with Delay 
Using the pole-zero mapping (matched z-transform), find the discrete-time 
equivalent of an analog system 

G(s) = -^—e~ 0 - 95s (P6.6.1) 

s +2 

with sampling period T = 1/4 [s]. 
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This chapter introduces how to use MATLAB for designing analog and digital 
filters such that the given specification on the frequency response is satisfied. Espe¬ 
cially for analog filters, the MATLAB routines to perform circuit-level design are 
also introduced. 

7.1 Analog Filter Design 

This section has been excerpted from Sect. 8.6 of [Y-2] (Yang, Won Y. and Seung 
C. Lee, Circuit Systems with MATLAB and PSpice, John Wiley & Sons, Inc., New 
Jersey, 2007.). Fig 7.1(a)/(b)/(c)/(d) show typical lowpass/bandpass/bandstop/ high- 
pass filter specifications on their log-magnitude, 20 log 10 \G(jw)\ [dB], of frequency 
response. The filter specification can be described as follows: 

201og 10 \G{jco p )\ > — 7?p[dB] for the passband (7.1.1a) 

20log 10 |G(M)I < — Ar[dB] for the stopband (7.1.1b) 

where co p , co s , R p , and As are referred to as the passband edge frequency, the 
stopband edge frequency, the passband ripple, and the stopband attenuation, respec¬ 
tively. The most commonly used analog filter design techniques are the Butterworth, 
Chebyshev I, II, and elliptic ones ([K-2], Chap. 8). MATLAB has the built-in 
functions butt (), chebyl (), cheby2 (), and ellipO for designing the 
four types of analog/digital filter. As summarized below, butt () needs the 3dB 
cutoff frequency while chebyl () and ellip () get the critical passband edge 


W.Y. Yang et al., Signals and Systems with MATLAB®, 

DOI 10.1007/978-3-540-92954-3-7, © Springer-Verlag Berlin Heidelberg 2009 
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frequency and cheby2 () the critical stopband edge frequency as one of their input 
arguments. The parametric frequencies together with the filter order can be prede¬ 
termined using buttord (), cheblord(), cheb2ord (), and allipord (). 
The frequency input argument should be given in two-dimensional vector for 
designing BPF or BSF. Also for HPF/BSF, the string 'high' / 'stop' should 
be given as an optional input argument together with 's' for analog filter design. 



(a) Typical specification of lowpass filter (b) Typical specification of bandpass filter 



transition band transition band transition band 

(d) Typical specification of highpass filter (c) Typical specification of bandstop filter 


Fig. 7.1 Specification on the log-magnitude of the frequency response of an analog filter 
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|-►j<3o( s )|' 



G(s)=G 0 (s)+5;^ =1 GJs) 

(a) Cascade form (b) Parallel form 

Fig. 7.2 Two realizations of an analog filter (system or transfer function) 


The designed filter system functions are often factored into the sum or product of 
second-order sections called biquads (possibly with an additional first-order section 
in the case of an odd filter order) as 

m bn\s + bm m b m \s~ 4- bmos + b,„-K 

G(s) =KGo(s) n G m (s)=K — -- n -—-— (7.1.2a) 

m=l S + ao2 m=\ S z + a m iS + a m 3 

with M — floor (y) 

b m lS 2 + b,„2S + b m 3 
s 2 + a„ as + a m 3 

(7.1.2b) 


E m bm s boo x— 

, G m {s) = , + V 

m=l S + am 


•(?) 


and then realized in cascade or parallel form, respectively as depicted in Fig. 7.2. 

Rather than reviewing the design procedures, let us use the MATLAB functions 
to design a Butterworth lowpass filter, a Chebyshev I bandpass filter, a Chebyshev 
II bandstop filter, and elliptic highpass filter in the following example. 

Example 7.1 Analog Filter Design Using the MATLAB Functions 

Let us find the system functions of analog filters meeting the specifications 
given below. 

(a) We are going to determine the system function of a Butterworth lowpass filter with 

co p = 2tt x 6000[rad/s], w s =2nx 15000 [rad/s], R p = 2[dB], and 
A s = 25 [dB] (E7.1.1) 


First, we use the MATLAB function ‘buttordO’ to find the filter order N and 
the cutoff frequency w c at which 201og 10 \ G(joj c )\ = —3 [dB] by typing the 
following statements into the MATLAB command window: 
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»wp=2*pi*6000; ws=*&*gi*15000; Rp=2; As=25; 

■frliormat short e, [N, wc] =buttord (wp, ws, Rp, As, ' s' ) 

N = A, wc = 4.5914e+004 

We put these parameter values N and wc into the Butterworth filter design func¬ 
tion ‘butter()’ as its first and second input arguments: 


» [Bfc;,Ab] =but|i'ft,(N,wc,' s' ) 

Bb = 0 0 0 0 4.4440e+018 

Ab = 1.0000e+000 1.1998©+0|^" 7.1974e+009 2.5292e+014 4.4440e+018 

This means that the system function of the designed Butterworth LPF of order 
N=4 is 


G(s) = 


4.444 x 10 18 


s 4 + 1.1998 x 10 5 s 3 + 7.1974 x 10V + 2.5292 x 10 14 s + 4.444 x 10 18 

(E7.1.2) 


We can find the cascade and parallel realizations of this system function by typing 
the following statements into the MATLAB command window: 


»[SOS,K]=tf2sos(Bb,Ab); % cascade realization 

»Ns = size (SOS, 1) ; »Gm=K~ (1/Ns) , BBc=SOS ( : , 1 : 3) , AAc=SOS(: , 4 : 6) 

- 2.1081e+®Cja 

BBc = 0 0 1 AAc = 1.0000e+000 3.5141e+004 2.1081e+009 

0 0 1 1.0000e+000, 8.4838e+004 2.1081e+009 

» 18%.,AAp] =tf2par_s (Bb,Ab) % parallel realization (see Sect,. E.15) 

BBp = 0 4.2419e+004 3.5987e+009 

0 -4.2419e+O0.4 -1.4906e+009 

AAp = 1.0000e+000 8.4838e+004 2.1081e+hff9‘ 

1.00004t®§0 3.5141e+004 2.10Sle-MSg* 

This means that the designed system function can be realized in cascade and 
parallel form as 

2.108 x 10 9 2.108 x 10 9 

(,S) “ i 2 + 3.514 x 10 4 s +2.108 x 10 9 X i 2 + 8.484 x 10 4 s+2.108 x 10 9 

(E7.1.3a) 


G(s) = 


4.242 x 10 4 s + 3.599 x 10 9 
s 2 + 8 4 84 x 10 4 s + 2.108 x 10 9 


4.242 x 
.v 2 + 3.514 


10 4 s + 1.491 x 10 9 


< 10 4 s +2.108 x 10 9 
(E7.1.3b) 


(b)We are going to determine the system function of a Chebyshev I bandpass fil¬ 
ter with 


co s i =2 ji x 6000, (Dpi = 2n x 10000, co p 2 = 2n x 12000, 
w s2 = 2 ji x 15000 [rad/s], R p = 2 [dB], and A s = 25 [dB] (E7.1.4) 

First, we use the MATLAB function ‘cheblordO’ to find the filter order N and 
the critical passband edge frequencies co pc 1 and co pc 2 at which the passband rip¬ 
ple condition is closely met, i.e., 201og 10 \ G(Joj pc )\ = —R p [dB] by typing the 
following statements: 
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»wsl=2*pi*6e3; wpl=2*pi*le4; wp2=2*pi*12e3; ws2=2*pi*15e3; Rp=2; As=25; 
>>[N,wpc]=cheblord([wpl wp2],[wsl ws2], Rp, As,' s' ) 

N = 2, wpc = 6.2832e+004 7.5398e+004 

We put the (half) filter order N, the passband ripple Rp, and the critical passband 
edge frequency vector wpc = [co pc \ co pc 2] into the Chebyshev I filter design 
function ‘chebyl()’ as 

>>[Bel,Acl]=chebyl(N,Rp,wpc,' s') 

JtcJ, = 00 : ,C324et 008 0 0 

Ac'. : . OOCOe i 600 : .0:0:ot-0C4 9.6048e+009 4.7853e+013 : '2,2 4 4»e*ltt9 

This means that the system function of the designed Chebyshev I BPF of order 
2N=4 is 

L° 324 x 10 8 s 2 

S ~~ s 4 + 10101s 3 + 9.6048 x 10V + 4.7853 x 10 13 s + 2.2443 x 10 19 

(E7.1.5) 

We can find the cascade and parallel realizations of this system function by typing 
the following statements into the MATLAB command window: 

»[SOS,K]=tf2sos(Bel,Acl); % cascade realization 

»Ns=size (SOS, 1) ; Gm=K~ (1/Ns) , BBc=SOS (:, 1: 3) , AAc=SOS (:, 4 : 6) 

Gm = 1.0161e+004 

BBc = 0 0 1 AAc = 1.0000e+000 5.4247e+003 5.4956e+009 

101 1.0000e+000 4.6763e+003 4.0838e+009 

>> [BBp, AAp] =tf2par_s (Bel, Acl) % parallel realizatipr 

BBp = 0 1.8390e+002 4.0242e+&08 

0 -1.8390e+002 -2.9904e+flO8 

AAp = 1.0000e+000 5.4247e+003, .S. 4 9SSe*O0'9 

1.0000e+000 4.6763e+003 4. ■ O838e+O09 

This means that the designed system function can be realized in cascade and 
parallel form as 


1.0161 x 10 4 s 1.0161 x 10 4 s 

S ~~ s 2 + 5.425 x 10 3 s + 5.496 x 10 9 X s 2 + 4.676 x 10 3 s + 4.084 x 10 9 

(E7.1.6a) 

1.839 x 10 2 s + 4.024 x 10 8 1.839 x 10 2 i + 2.990 x 10 8 

* _ i 2 + 5.425 x 10 3 s + 5.496 x 10 9 i 2 + 4.676 x 10 3 s + 4.084 x 10 9 

(E7.1.6b) 

(c)We are going to determine the system function of a Chebyshev II bandstop 
filter with 

co pl =2;r x 6000, co s i = 2n x 10000, co s2 = 2 tt x 12000, 

(D p2 = 2n x 15000 [rad/s], R p = 2 [dB], and A s = 25 [dB] (E7.1.7) 

First, we use the MATLAB function ‘cheb2ord()’ to find the filter order N and 
the critical stopband edge frequencies co sc i and w SC 2 at which the stopband atten¬ 
uation condition is closely met, i.e., 201og 10 \ G(jco sc )\ = —A s [dB] by typing 
the following statements: 
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»wpl=2*pi*6000; wsl=2*pi*lO0OO; ws2~2*pi*.:lfi00; wp2=2,+pi*15000; 
»Rp=2; As=25; 

>>[N,wsc]=cheb2ord([wpl wp2],[wsl ws2],Rp,As,'s') 

N-»i, wsc = 6.2798e+004 7.5438e+004 

We put the (half) filter order N, the stopband attenuation As, and the critical 
stopband edge frequency vector wsc = [co sc i co SC 2] into the Chebyshev II filter 
design function ‘cheby2()’ as 

>>;Bc2,Ac2|-cheby2<N,As,wsc,'stop', 's' ) 

Bc2 - 1.0000e+000 1.0979e-010 9 .$S0e+OO9 4.9629e-001 2.2443e+019 

Ac2 = 1.0000e+000 5.1782e+004 1.0895e+010 2.45316+014 2.2443e+019 

This means that the system function of the designed Chebyshev II BSF of order 
2N = 4 is 


s 4 + 9.5547 x 10V + 4.9629 x KT 1 * + 2.2443 x 10 19 

* ~~ s 4 + 51782s 3 + 1.0895 x 10 10 s 2 + 2.4531 x 10 14 s + 2.2443 x 10 19 

(E7.1.8) 

We can find the cascade and parallel realizations of this system function by typing 
the following statements into the MATLAB command window: 


»(SPf,K]=tf2sos (Bc2,Ac2) ; % cascade realization [BBc, AAc] =tf 2cas (B, A) 
»Ns=size (SOS, 1) ; Gm=IC(l/Ns), BBc=SOS (:, 1: 3) , AAc=SOS (: , 4 : 6) 

Gm = 1 

BBc = 1.0Q00e+000 7.7795e-011 5.3938e+009 

i.OOOOe+OOO 2.9104e-011 4.1609e+009 

AAc = l.QOp&sWoO 3.1028pWo4 7.0828e+009 

l.QOQ&S+fiOO 2.0'TSfe+'W# 3.16876+00® 

>> [BBp, AAp] =tf 2par_s (Bc2, Ac2) % parffeJJ|3% realization 

BBp = 5.0000e-001 -1.5688e+004 3.4426e+009 

5.0000e-001 -1.O'204e+OO4 1.6285e+009 

AAp = l.QOOfie+OOO 3.1028^Ofe-; 7.0828e+009 

l.Qtj06$+'0OO 2 . 3.1687e+0G® 

This means that the designed system function can be realized in cascade and 
parallel form as 

i 2 +5.394 x 10 s s 2 + 4.161 x 10 9 

~ .v 2 +3.103 x 10 4 i +7.083 x 10 s X i 2 + 2.075 x lO 4 * + 3.169 x 10 s 

(E7.1.9a) 


0.5i 2 - 1.569 x 10 4 s + 3.443 x 10 s 
(V _ j 2 4-3.103 x 104^ +7.083 x 10 s 


0.5i 2 - 1.020 x 10 4 i + 1.6285 x 10 s 
i 2 +2.075 x 104^ +3.169 x 10 s 

(E7.1.9b) 


(d)We are going to determine the system function of an elliptic highpass filter with 

<o s = 2n x 6000 [rad/s], oo p = 2n x 15000 [rad/s], R p = 2 [dB], and A s = 25 [dB] 

(E7.1.10) 

First, we use the MATLAB function ‘ellipordO’ to find the filter order N and the 
critical passband edge frequency co pc at which 201og 10 \G(jco pc )\ — —R p [dB] 
by typing the following statements into the MATLAB command window: 
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»ws=2*pi*6000; wp=2*pi*15000; Rp=2; As=25; 

■ crtr.at. short e, [N, wc] =gsi3ytpord(wp, ws,Rp, As, ' s') 

N = 3, wc = 9.4248e+004 

We put the parameter values N, Rp, As, and wc into the elliptic filter design 
function ‘ellipO’ as 


■ [Be, Ae] =ellip (N, Rp, As, wc,' ' s' ) 

Be = 1.0000e+000 8.9574e-009 3.9429e+009 -5.6429e+002 
Ae = 1. OOOOe+OOD 2.3303e+005 1.4972e+010 1.9511e+015 


This means that the system function of the designed elliptic HPF of order N = 3 is 
s 3 + 3.9429 x 10 9 s - 5.6429 x 10 2 ( ( 

5 ~~ s 3 + 2.3303 x 10 5 s 2 + 1.4972 x 10 10 s + 1.9511 x 10 15 


We can find the cascade and parallel realizations of this system function by typing 
the following statements into the MATLAB command window: 


>>[SOS,K]=tf2sos(Be,Ae); % cascade realization 

»Ns=size(SOS,1); Gm=K*(1/Ns), BBc=SOS(:,1:3), AAc=SOS(:,4:6) 


Gm = 1.0000e+000 

BBc = 1.0000e+000 -1.4311e-007 1 

* itfOftQe+OOO '. . 5?.37'e--Q07 3.9429e+009 

AAc = IVghOOe+OOO 2.0630e+005 0 

'.. 0000c < COO 2.6731e+004 9.4575e+009 

>[BBp,AAp]=tf2par_s (Be, Ae) % parallel realization 

BBp = 5.0000e-001 -1.3365e+004 4.7287e+009 

:tt 5.OGCCe OQl -l.O315e+O0S 

AAp = liioOOe+OOO 2.6731erpC4 9.45;73e+009 

0 1 . OOOCe- CCC .2 . C63Ge l O05- 


This means that the designed system function can be realized in cascade and 
parallel form as 


G(s) = 


s + 2.063 x 10 s 


,s 2 + 3.943 x 10 9 
s 2 + 2.673 x 10 4 s + 9.458 x 10 9 


(E7.1.12a) 


0.5s 2 - 1.337 x 10 4 s + 4.729 x 10 9 0.5s - 1.032 x 10 5 

* _ s 2 + 2.673 x 10 4 s + 9.458 x 10 9 + s + 2.063 x 10 5 

(E7.1.12b) 

(e)All the above filter design works are put into the M-file named “sig07e01.m”, 
which plots the frequency responses of the designed filters so that one can check 
if the design specifications are satisfied. Figure 7.3, obtained by running the 
program “sig07e01.m”, shows the following points: 

- Figure 7.3(a) shows that the cutoff frequency co c given as an input argument of 
‘butter()’ is the frequency at which 201og 10 \G(jw c )\ — —3 [dB], Note that the 
frequency response magnitude of a Butterworth filter is monotonic, i.e., has no 
ripple. 
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Fig. 7.3 Frequency responses of the filters designed in Example 7.1 


Figure 7.3(b) shows that the critical passband edge frequencies co pc i and co pc 2 
given as an input argument wpc = [wpcl wpc2] of ‘cheby 1()’ are the frequencies 
at which the passband ripple condition is closely met, i.e., 201og 10 \G(jw pc )\ = 
— R p [dB], Note that the frequency response magnitude of a Chebyshev I filter 
satisfying the passband ripple condition closely has a ripple in the passband, 
which is traded off for a narrower transition band than the Butterworth filter (with 
the same filter order). 

Figure 7.3(c) shows that the critical stopband edge frequencies co sc \ and co sc 2 
given as an input argument wsc = [wscl wps2] of ‘cheby2()’ are the frequen¬ 
cies at which the stopband attenuation condition is closely met, i.e., 20 log 10 | 
G(ja) sc )\ = —A s [dB], Note that the frequency response magnitude of a Cheby¬ 
shev II filter satisfying the stopband attenuation condition closely has a ripple in 
the stopband. 

Figure 7.3(d) shows that the critical passband edge frequency co pc given as an 
input argument wpc of ‘ellipO’ is the frequency at which the passband ripple 
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condition is closely met, i.e., 201og 10 \ G(Jco pc )\ = —R p [dB], Note that the fre¬ 
quency response magnitude of an elliptic filter has ripples in both the passband 
and the stopband, yielding a relatively narrow transition band with the smallest 
filter order N = 3 among the four filters. 


%sig07e01.m for analog filter design and frequency response plot 
clear, elf, format short e 
disp('(a) Butterworth LPF') 

[Nb,wcb]= buttord(wp,ws,Rp,As,'s') % Order of analog BW LPF 
[Bb,Ab]= butter(Nb,web,'s') % num/den of analog BW LPF system ftn 
[SOS,K]= tf2sos(Bb,Ab); % cascade realization [BBc,AAc]=tf2cas(B,A) 
Ns=size(SOS,1); Gm=K"(1/Ns), BBc=SOS(:,1:3), AAc=SOS(:,4:6) 

[BBp,AAp] = tf2par_s (Bb,Ab) % parallel realization — see Sect. E.15 
ww= logspace(4,6,1000); % log frequency vector from le4 to le6[rad/s] 
subplot(221), semilogx(ww,20*logl0(abs(freqs(Bb,Ab,ww)))) 
title('Butterworth LPF') 

disp('(b) Chebyshev I BPF') 

wsl=2*pi*6e3; wpl=2*pi*le4; wp2=2*pi*12e3; ws2=2*pi*15e3; Rp=2; As=25; 
[Ncl,wpc]= cheblord([wpl wp2],[wsl ws2],Rp,As,'s') 

[Bel,Acl]= chebyl(Ncl,Rp,wpc,'s') 

[SOS,K]= tf2sos(Bel,Acl); % cascade realization 
Ns=size(SOS,1); Gm=K"(1/Ns), BBc=SOS(:,1:3), AAc=SOS(:,4:6) 

[BBp,AAp]= tf2par_s(Bel,Acl) % parallel realization 
subplot(222), semilogx(ww,20*logl0(abs(freqs(Bel,Acl,ww)))) 
title('Chebyshev I BPF') 

disp('(c) Chebyshev II BSF') 

wpl=2*pi*6e3; wsl=2*pi*le4; ws2=2*pi*12e3; wp2=2*pi*15e3; Rp=2; As=25; 
[Nc2,wsc]= cheb2ord([wpl wp2],[wsl ws2],Rp,As,'s') 

[Bc2,Ac2]= cheby2(Nc2,As,wsc,'stop','s') 

[SOS,K]= tf2sos(Bc2,Ac2); % cascade realization 
Ns=size(SOS,1); Gm=IC (1/Ns), BBc=SOS(:,1:3), AAc=SOS(:,4:6) 

[BBp,AAp]= tf2par_s(Bc2,Ac2) % parallel realization 
subplot(224), semilogx(ww, 20*logl0(abs(freqs(Bc2,Ac2,ww)))) 
title('Chebyshev II BSF') 
disp('(d) Elliptic HPF' ) 

ws=2*pi*6000; wp=2*pi*15000; Rp=2; As=25; 

[Ne,wpc]= ellipord(wp,ws,Rp,As,'s') 

[Be,Ae]= ellip(Ne,Rp,As,wpc,'high','s') 

[SOS,K]= tf2sos(Be,Ae); % cascade realization 
Ns=size(SOS,1); Gm=K"(1/Ns), BBc=SOS(:,1:3), AAc=SOS(:,4:6) 

[BBp,AAp]= tf2par_s(Be,Ae) % parallel realization 
subplot(223), semilogx(ww,20*logl0(abs(freqs(Be,Ae,ww)))) 


Now we are going to conclude this section with some MATLAB routines that 
can be used to determine the parameters of the circuits depicted in Figs. 7.4, 7.5, 
and 7.6 so that they can realize the designed (second-order) system functions. See 
Chap. 8 of [Y-2] for more details. 
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6 V;(s) s 2 + G 2 (1/C 1 + 1/C 2 )+(1-/<)G 1 /C 1 )s+G 1 G 2 /C 1 C 2 

(a) A second-order Sallen-Key lowpass filter (b) A second-order Sallen-Key highpass filter 

Fig. 7.4 Second-order active filters 



(a) A second-order MFB (multi-feedback) LPF (b) A second-order MFB (multi-feedback) HPF 


Fig. 7.5 Second-order active filters 
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(a) A second-order MFB (multi-feedback) BPF (b) A second-order MFB (multi-feedback) BPF 


Fig. 7.6 Second-order active filters 


For example, we can use the MATLAB routine ‘filter_BPF_7_6a()’ to tune the 
parameters of the MFB (multiple feedback) circuit of Fig. 7.6(a) so that the circuit 
realizes the following BPF system function 

= _ ~(Gi/C 3 > __ -100* 

* 2 + (( J 5 CC 3 + C4)/C3C4)* + (G1 + G 2 )G5/C3C4 s 2 + 100* + 100 2 

(7.1.3) 

To this end, we have only to type the following statements into the MATLAB com¬ 
mand window: 

»B2 = 100; A2=100; A3=100|t|''% The desired system fdscsiah S2*:S/<s~2+&2*s+A3) 
»R2=le2; KC=3; % With the given value of R2=100 and the assumption that C3=C4 
>>-fe.3>Rl, R5, Gs] =f ilter_BPF_7_6a (32, A2, A3, R2, C, KC) 

C3=C4=1.0000e-004, Rl=9.9999e+001, R5=2.0000e+002 
Gs = -1 QO*s/(s'2+10:o*s+ 5497540047884755/54975S$13888) 
>>5497540047884755/549755813888 % To see the weird constant term 
1. OdOOe#OD : 4 

For another example, we can use the MATLAB routine ‘filter_LPF_7_4a()’ to 
tune the parameters of the Sallen-Key circuit of Fig. 7.4(a) so that the circuit realizes 
the following LPF system function: 

_ KG X G 1 !C X C 1 _ Kw 2 r 

* 2 + ((Gi + G2)/Ci + (1 — K)G 2 /C 2 )* + G 1 G 2 /C 1 C 2 * 2 + a>bS + w 2 

(7.1.4) 

More specifically, suppose we need to determine the values of R\ and Ri of the 
Sallen-Key circuit of Fig. 7.4(a) with the pre-determined values of capacitances 
Ci = C 2 = lOOpF so that it realizes a second-order LPF with the DC gain K — 1.5, 
the corner frequency co r = 2jt x 10 7 [rad/s], and the quality factor Q = 0.707 (for 
cob = (o r /Q). To this end, we have only to type the following statements into the 
MATLAB command window: 

»K=l.^f' C2=ler:l#| wr=2*pi*le7; Q 0.707; 

% The coefficients of denominator of desired system ftn 
»A2=wr/Q; A3=wr"2; % G(s)=K*A3/(s"2+A2*s+A3) 

»KC=2; [Rl, R2, Gs] = f ilter_LPF_7_4a (A2, A3, K, Cl, C2, KC) 
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Gs = 5?Z:1762e400SSfit5/ (s"2+5964037174912491/67id«e64*s+7895683520871487/2) 

(cf) For reference, you can visit the web site <http://www.national.com/pf/LM/ 
LMH6628.html> to see the application note OA-26 for Designing Active High 
Speed Filters. 

To illustrate the filter design and realization procedure collectively, let us find 
the cascade realization of a fourth-order Butterworth LPF with cutoff frequency 
w c — 10 kHz using the Sallen-Key circuit of Fig. 7.4(a). For this job, we compose 
the following program and run it: 



(cf) Note that multiplying all the resistances/capacitances by the same constant does 
not change the system function and frequency response. This implies that if 
you want to scale up/down the tuned capacitances/resistances without affecting 
the system function and frequency response, you can scale up/down the pre¬ 
determined values of resistances/capacitances in the same ratio. 

7.2 Digital Filter Design 

Digital filters can be classified into IIR (infinite-duration impulse response) or FIR 
(finite-duration impulse response) filter depending on whether the duration of the 
impulse response is infinite or finite. If the system function of a filter has a polyno¬ 
mial in z or z -1 of degree one or higher (in addition to a single z N or z~ N term) in 
its denominator, its impulse response has an infinite duration. For example, consider 
a filter whose system function is 


G[z] = 


Y[Z ] 
X[z] 


z — 0.5 


(7.2.1) 
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so that the z-domian and time-domain input-output relationships are 

(z - 0.5 )Y[z] = X[z]; zY[z] - 0.57[z] = X[z]; zY[z ] = 0.5F[z] + X[z]; 
y\n + l]=0.5y[n]+x[n] (7.2.2) 


This means that the output y[n + 1] of this recursive difference equation is affected 
by not only the input x[n] but also the previous output y[ri\. That is why the impulse 
response of the filter has indefinitely long duration. In contrast with this, the dura¬ 
tion of the impulse response of a FIR filter is equal to one plus the degree of the 
(numerator) polynomial in z or z _1 of its system function (having no denominator). 
For example, consider a filter whose system function is 


GW = 1 = ‘ 


+ 3z 3 


z 3 - 2z 2 + 0z + 3 

z 3 


(7.2.3) 


so that the z-domian and time-domain input-output relationships are 


Y[z] = (1 - 2z -1 + 3 z -3 )X[z]; 
y\n] = x[n ] - 2 x[n - 1] + 3 x[n - 3] (7.2.4) 


The output y[n] of this nonrecursive difference equation is affected not by any pre¬ 
vious output, but only by the input terms. That is why the impulse response of the 
filter has a finite duration. In fact, the impulse response of a FIR filter is identical 
to the filter coefficients, say, [1 — 2 0 3] in the case of this filter having the system 
function (7.2.3). 

In this section we will see how to design the HR and FIR filters using the 
MATLAB software. 


7.2.1 HR Filter Design 

The methods of designing HR filters introduced here are basically the discretizations 
of analog filters dealt with in Sect. 7.1. We will use the same MATLAB functions 
that are used for analog filter design. 

Example 7.2 HR Filter Design 

Let us find the system functions of digital filters (with sampling frequency F s — 
50 [kHz]) meeting the specifications given below. 

(a) We are going to determine the system function of a digital Butterworth lowpass 
filter with the passband/stopband edge frequencies, passband ripple, and stop- 
band attenuation as 

co p = 2ttx6000 [rad/s], <o s = 2n x 15000 [rad/s], R p = 2[dB], and A = 25 [dB| 

(E7.2.1) 
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First, we prewarp the edge frequencies, design an analog Butterworth LPF satis¬ 
fying the given specifications on the passband ripple and stopband attenuation at 
the prewarped passband and stopband edge frequencies, and then discretize the 
LPF through bilinear transformation: 



Kp = -4.140-86^061 









Fig. 7.8 Design of a digital Butterworth LPF with order 3 and cutoff frequency 0.309 using 
FDAtool 


This result means that the system function of the designed Butterworth LPF of 
order N = 3 is 


0.05323z 3 + 0.1597z 2 + 0.1597z + 0.05323 
= z 3 - 1.1084z 2 + 0.6629z - 0.1286 
0.05323(z 2 + 2z + l)( z + 1) 

= (z 2 - 0.7992z + 0.4157)(z - 0.3092) ' 3SCa 
-0.9949z 2 + 0.5616z 1.4622z 


Direct form (E7.2.2a) 


z 2 - 0.7992z + 0.4157 


- 0.4141 : Parallel form 


(E7.2.2c) 
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The magnitude curve of the frequency response of the designed filter is shown 
in Fig. 7.7. If the order and cutoff frequency are determined, then we can use the 
FDATool to design a digital filter as depicted in Fig. 7.8 where the same cascade 
realization is obtained as with butter (). Note that the cutoff frequency fcb 
determined by buttord () and used by butter () and FDATool is normal¬ 
ized to the range of [0,1] with 1 corresponding to Fs/2[Hz] (half the sampling 
frequency). 

(b)We are going to determine the system function of a Chebyshev IBPF with 

co s i = 2n x 6000, w pl = In x 10000 , w p2 = 2n x 12000, 
co s2 = 2;r X 15000[rad/s], R p = 2 [dB], and A s = 25 [dB] (E7.2.3) 

First, we prewarp the edge frequencies, design an analog chebyshev I BPF satis¬ 
fying the given specifications on the passband ripple and stopband attenuation at 
the prewarped passband and stopband edge frequencies, and then discretize the 
BPF through bilinear transformation: 

»Fs=5e4; T=l/Fs; % Sampling frequency and sampling period 
»wsl=2*pi*6e3; wpl=2*pi*le4; wp2=2*pi*12e3; ws2=2*pi*15e3; Rp=2; As=25; 
>>wp_p=prewarp ( [wpl wp2] , T) ; ws_p=prewarp ( [wsl ws2] , T) ; % Prewarp 
» [N, wpc] =clieblord(wp_p, ws_p, Rp, As,' s') %Order & cutoff freq of A-Cl BPF 
N = 2, wpc = 7.2654e+004 9.3906e+0£M 

>> [Bel, Acl] =chebyl (N, Rp, wpc,' s') % fifWt/den of analog Cl BPF system ftn 
¥»[Bol.dja,Acl.dO]= bilinear ($£$*Acl, Fs) % Bilinear transformation'' 

The MATLAB function chebyl() can also be used to design a digital 
Chebyshev I filter directly as follows: 

»fp«[wpl wp2]*T/pi; fs=[wsl wsi'l %Normalize edge freq into [0,1] 

» [Ncl, fcql] =cheblord(fp, fs, Rp, As) % Order & Cutoff freq of D-'djL.BPF 
Ncl = 2, dl 'k 0.4 0.48 

» [Bcl_d, Acl_d] = chebyl (Ncl, Rp, feel) num/den of D-Cl BPF system ftn 
Bcl_d = 9.3603e-03 0 -1.8721e-02 0 9.3603e-03 

Acl_d = 1.0000e+00 -7.1207e-01 1.8987e+00 -6.4335e-01 8.1780e-01 
»[SOS,Kc]= tf2sos (Bcl.d,Acl_d) % Cascade form ®@iiizatigji. 

SOS =1 2 1 1.0000e+000 :.6430C-0C: 9.0250e-001 

1 -2 1 1.0000e+000 -5.4780e-0.01 9.0610e-001 

Kc = 9.3603e 003 

»[BBp,AAp, Kp] = tf2pa‘j?;.e (Bcl_d,Adl_d) % Parallel form realization 
BBp = -1.991fe-4jif 8.9464e'-0C2. 0 

-9.43l6e-0ffil 9.72366-002 0 

AAp = l.OQO'Oe+ffa'O; -5.4785e-001 9.0612e-001 

:.COCOe-OCC -1.6432e-001 9.0253e-001 

Kp = 1.1446e-002 

This means that the system function of the designed Chebyshev I BPF of order 
2Ncl = 4 is 
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, 9.3603 x 10-V - 1.8721 x 10“ 2 z 2 + 9.3603 x 10" 3 _ 

0.7121,3 + 1.8987;*-0.6434; + 0.8178 : 


9.3603 x 10 _3 (z 2 + 2z+ l)(z 2 - 2z + 1) 


' (z 2 - 0.1643z + 0.9025)(z 2 - 0.5478z + 0.9061) 
0.10855 x 0.10855 x 0.7943(z 2 - l)(z 2 - 1) 


: Cascade form 

(E7.2.4M) 


' (z 2 - 0.1643z + 0.9025)(z 2 - 0.5478z + 0.9061) 
-9.4316 x 10“ 5 z 2 + 9.7236 x 10" 2 z 


Cascade form 

(E7.2.4b2) 


z 2 — 0.1643z + 0.9025 
-1.991 x 10 _3 z 2 - 8.9464 x 10“ 2 z 


z 2 - 0.5478z + 0.9061 



Fig. 7.10 Design of a digital Chebyshev IBPF with order 4 and passband edge frequencies 0.4 & 
0.48 using FDAtool 
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The magnitude curve of the frequency response of the designed filter is shown in 
Fig. 7.9. If the order and passband edge frequencies are determined, then we 
use the FDATool to design a digital filter as depicted in Fig. 7.10 where the 
same cascade realization is obtained as with chebyl (). Note that the critical 
passband edge frequencies fccl(l) and fccl(2) determined by cheblordO 
and used by chebyl () and FDATool are normalized to the range of [0,1] 
with 1 corresponding to Fs/2[Hz] (half the sampling frequency, i.e., the Nyquist 
frequency). 

(c)We are going to determine the system function of a Chebyshev IIBSF with 

w p i = 2;r x 6000, co s i = 2 tt x 10000, co s2 = 2 tt x 12000, 
co p2 = 2 jtx 15000 [rad/s], R p = 2 [dB], and A s = 25 [dB] (E7.2.5) 

Let us use the MATLAB function cheby2 () to design a digital Chebyshev II 
filter directly as follows: 


»Fs=5e4; T=l/Fs; % Sampling frequency and sampling period 
»wpl=2*pi*6e3; wsl=2*pi*le4; ws2=2*pi*12e3; wp2=2*pi*15e3; Rp=2; As=25; 
»fp=[wpl wp2]*T/pi; fs-twsl ws2]*T/pi; %Normalize edge freq into [0,1] 
»[Nc2,fcc2]=cheb2ordtfp,fs,Rp,As) % Order & Cutoff freq of BSF 

H62 = 2, fee?. = 0.4 0.48 

>> [BcZ-d, Ac2_d] =cheby2 (Nc2, As, fcc2,' stop' ) %D-C2 BSF system ftn 

Bc2_d = 6.0743e-01 -4.5527e-01 1.2816e+00 -4.5527e-01 6.0 7 4:3^01 
Ac;2_d = 1.000f>*MD0 -5.7»7«^tti 1.1203e+00 -3.3746e-01 3.7625e-01 
»[SOS,Kc]#.4f2s6s(Bc2_d,Ac2_d) % Cascade form realization' 

SOS = 1 ' -0.2000 1 1.0000 ef QffO 1.4835e-001 5.9730e-001 

1 -0.5495 1 1. OO’fiiJe+OOO -7.2143e-001 6.2992e-001 

Kc = 6.0743e-Q01 

>> [BBp, AAp, Kp] = tf2par_z (Bc2_d,Ac2_d) % Parallel form realization 
BBp = -4.7229e-6'|£‘ 2.3377#-O01 0 

5.3469o OCi -7.9541e-002 0 

AAp = 1. OOOOe+00®- -7.2143e-001 6.2992e-o||, ' 

l.OOOOe+efiO 1.4835£AQ01 5.9730e-0#. 

Kp = 1.6144e+00Q 


This means that the system function of the designed Chebyshev II BSF of order 
2Nc2 = 4 is 


0.6074z 4 - 0.4553z 3 + 1.2816z 2 - 0.4553z + 0.6074 
z 4 - 0.5731 z 3 + 1.1202z 2 - 0.3375z + 0.3763 

0.6074(z 2 - 0.2z + l)(z 2 - 0.5495z + 1) 

= (z 2 - 0.1484z + 0.5973)(z 2 - 0.7214z + 0.6299) : aS 


Direct form 
(E7.2.6a) 


-0.4723z 2 + 0.2338z -0.5347z 2 - 0.07954z , ^^ 

_I_i_ j 6144 

z 2 -0.7214z +0.6299 z 2 + 0.1484z + 0.5973 

: Parallel form (E7.2.6c) 
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The magnitude curve of the frequency response of the designed filter is shown 
in Fig. 7.11. If the order and stopband edge frequencies are determined, then we 
can use the FDATool to design a digital filter as depicted in Fig. 7.12 where the 
same cascade realization is obtained as with cheby2 (). Note that the critical 
stopband edge frequencies fcc2(l) and fcc2(2) determined by cheb2ord () and 
used by cheby2 () and FDATool are normalized to the range of [0,1] with 1 
corresponding to Fs/2[Hz], Note also that as can be seen from the magnitude 
curves in Fig. 7.11, the Chebyshev II type filter closely meets the specification 
on the stopband attenuation (A s > 25[dB]), while it satisfies that on the passband 
ripple ( R p < 2[dB]) with some margin. 



(a) From MATLAB (b) From the FDAtool 


Fig. 7.11 The magnitude curves of the frequency response of the digital Chebyshev IIBSF 



Fig. 7.12 Design of a digital Chebyshev II BSF with order 4 and stopband edge frequencies 0.4 & 
0.48 using FDAtool (version 7.2-R2006a) 
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(d)We are going to determine the system function of an elliptic HPF with 

co 5 = 2tt x 6000 [rad/s], co p = In x 15000 [rad/s], R p = 2 [dB], and A, = 25 [dB] 

(E7.2.7) 

Let us use the MATLAB function el lip () to design a digital elliptic filter 
directly as follows: 

>>Fs=5e4; T=l/Fs; % Sampling frequency and sampling period 
»ws=2*pi*6e3; wp=2*pi*15e3; Rp=2; As=25; 

»fp=wp*T/pi; fs=ws*T/pi; %Normalize edge freq into [0,1] 

» [Ne, fce]=ellipord(fp, fs,Rp,As) % Order & Cutoff freq of D-elliptic HPF 
Ne = 2, fee =0.6 

» [Be_d,Ae_d]=ellip(Ne,Rp,As,fee,'high') %D-elliptic HPF system ftn 
Be_d = 2.0635e-001 -3.0101e-001 2.0635e-001 

Ae_d = 1.0000e+000 5.4365e-001 4.4217e-001 

>>[SOS,Kc]= tf2sos(Be_d,Ae_d) % Cascade form realization 

SOS = 1 -1.4587e+000 1 1.0000e+000 5.4365e-001 4.4217e-001 

Kc =• 2.0635e-001 

>>[BBp,AAp,Kp]= tf2par_z (Be_d, Ae_d) % Parallel form realization 
BBp = -2.6034e-001 -5.5472e-001 0 

AAp = 1.0000e+000 5.4365e-001 4.4217e-001 

Kp = 4.6669e-001 


This means that the system function of the designed elliptic HPF of order 
Ne = 2 is 


G[z] = 


0.2064z 2 - 0.301 Oz + 0.2064 
z 2 + 0.5437z + 0.4422 


0.2064(z 2 — 1.4587z+l) 
z 2 + 0.5437z + 0.4422 


: Cascade form 
(E7.2.8a) 


-0.2603z 2 - 0.5547z 
z 2 + 0.5437z + 0.4422 


0.4667 : Parallel form 


(E7.2.8b) 


%sig07e02.m for digital filter design and frequency response plot 

Fs=5e4; T=l/Fs; % Sampling frequency and sampling period 
disp('(a) Digital Butterworth LPF') 

fp=wp*T/pi; fs=ws*T/pi; 

[Nb,fcb]= buttord(fp,fs,Rp,As) % Order of analog BW LPF 

[Bb_d,Ab_d] = butter(Nb,feb) % num/den of digital BW LPF system ftn 

fn=[0:512]/512; W=pi*fn; 

% Plot the frequency response magnitude curve 

subplot (221) , plot (fn, 20*logl0 (abs (freqz (Bb_d, Ab_d, W) ) +eps) ) 

hold on, plot(fp,-Rp,'o', fcb,-3,'+', fs,-As,'x') 

[SOS,Kc]= tf2sos(Bb_d,Ab_d) % Cascade form realization 
[BBp,AAp,Kp]= tf2par_z (Bb_d, Ab_d) % Parallel form realization 
disp('(b) Digital Chebyshev I BPF') 

wsl=2*pi*6e3; wpl=2*pi*le4; wp2=2*pi*12e3; ws2=2*pi*15e3; Rp=2; As=25; 




7.2 Digital Filter Design 


329 


fp=[wpl wp2]*T/pi; fs=[wsl ws2]*T/pi; %Normalize edge freq into [0,1] 
[Ncl,feel]=cheblord(fp,fs,Rp,As) % Order & critical passband edge freq 
[Bcl_d,Acl_d] = chebyl(Ncl,Rp,feel) % num/den of D-Cl BPF system ftn 
subplot(222), plot(fn,20*logl0(abs(freqz(Bcl.d,Acl_d,W))+eps)) 

[SOS,Kc]= tf2sos(Bcl-d,Acl-d) % Cascade form realization 
[BBp, AAp, Kp] = tf2par_z (Bcl_d,Acl_d) % Parallel form realization 
disp('(c) Digital Chebyshev II BSF') 

wpl=2*pi*6e3; wsl=2*pi*le4; ws2=2*pi*12e3; wp2=2*pi*15e3; Rp=2; As=25; 
fp=[wpl wp2]*T/pi; fs=[wsl ws2]*T/pi; %Normalize edge freq into [0,1] 
[Nc2,fcc2]=cheb2ord(fp,fs,Rp,As) % Order & critical edge frequencies 
[Bc2_d,Ac2_d]=cheby2(Nc2,As,fcc2,'stop') %num/den of D-C2 BSF system ftn 
subplot(223), plot(fn,20*logl0(abs(freqz(Bc2_d,Ac2_d,W))+eps)) 

[SOS,Kc]= tf2sos(Bc2_d,Ac2_d) % Cascade form realization 
[BBp, AAp, Kp] = tf2par_z (Bc2_d, Ac2_d) % Parallel form realization 
disp('(d) Digital elliptic HPF') 
ws=2*pi*6000; wp=2*pi*15000; Rp=2; As=25; 
fp=wp*T/pi; fs=ws*T/pi; %Normalize edge freq into [0,1] 

[Ne,fee]=ellipord(fp,fs,Rp,As) % Order & Cutoff freq of D-elliptic HPF 
[Be_d,Ae_d]=ellip(Ne,Rp,As,fce,'high') % D-elliptic HPF system ftn 
subplot (224) , plot (fn, 20*logl0 (abs (freqz (Be_d, Ae_d, W) ) +eps) ) 

[SOS,Kc]= tf2sos(Be_d,Ae_d) % Cascade form realization 

[BBp,AAp,Kp]= tf2par_z (Be_d, Ae_d) % Parallel form realization: 


The magnitude curve of the frequency response of the designed filter is shown 
in Fig. 7.13. If the order and cutoff frequency are determined, then we use the 
FDATool to design a digital filter as depicted in Fig. 7.14, yielding the cascade 
realization close to that obtained with el lip (). Note that the cutoff frequency 
fee determined by ellipord () and used by el lip () and FDATool is nor¬ 
malized to the range of [0,1] with 1 corresponding to Fs/2[Hz] (half the sampling 
frequency). 

(e)All the above filter design works are put into the M-file named “sig07e02.m”, 
which plots the frequency responses of the designed filters so that one can check 
if the design specifications are satisfied. Figs. 7.7(a), 7.9(a), 7.11(a), and 7.13(a), 
obtained by running the program “sig07e02.m”, show the following points: 

- Figure 7.7(a) shows the monotone frequency response magnitude of a Butter- 
worth filter. 

- Figure 7.9(a) shows that the critical passband edge frequencies f p \ and f p 2 
given as an input argument feel = [fpl fp2] of ‘chebyl()’ are the frequencies 
at which the passband ripple condition is closely met. Note that the frequency 
response magnitude of a Chebyshev I filter satisfying the passband ripple con¬ 
dition closely has a ripple in the passband, which is traded off for a narrower 
transition band than the Butterworth filter (with the same filter order). 

- Figure 7.11(a) shows that the critical stopband edge frequencies f s \ and f s 2 
given as an input argument fcc2 = [fsl fs2] of ‘cheby2()’ are the frequencies 
at which the stopband attenuation condition is closely met. Note that the fre¬ 
quency response magnitude of a Chebyshev II filter satisfying the stopband 
attenuation condition closely has a ripple in the stopband. 




□ Conjugate 
| [71 Auto Update 


iign of a digital elliptic HPF wil 
FDAtool (version 7.2-R2006a) 
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Fig. 7.15 The state diagram of a filter drawn by the ‘Realize Model’ function of FDAtool 


- Figure 7.13(a) shows that the critical passband edge frequency f p given as an 
input argument fee of ‘ellipO’ is the frequency at which the passband ripple 
condition is closely met. Note that the frequency response magnitude of an 
elliptic filter has ripples in both the passband and the stopband, yielding a 
relatively narrow transition band with the smallest filter order N = 2 among 
the four filters. 

Note that we can click the Realize Model button or the Pole/Zero Editor button 
on the left-hand side of the FDATool window to create a Simulink model file 
having the designed filter block as depicted in Fig. 7.15 or to see the pole/zero 
plot of the designed filter as illustrated in Fig. 7.14. 


7.2.2 FIR Filter Design 


FIR filters are compared with HR filters 
Advantages: 

- FIR filters can have exactly linear 
phase. 

- FIR filters are stable. 


as follows: 

Disadvantages: 

- FIR filters require a much higher 
filter order than HR filters to achieve a 
given level of performance. 

- The delay of FIR filters is often much 
greater than that of an equal 
performance HR filter. 


According to the signal processing toolbox user’s guide (page 2-16), FIR filter 
design methods cast into MATLAB functions are listed in Table 7.1. 
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Table 7.1 FIR filter design methods 


Windowing 

Apply windowing to truncated IDFT of 
desired “brick wall” filter 

firl(), fir2 () 

Multibands with 
transition bands 

Equiripple or least squares approach over 
subbands of the frequency range 

firpm(), fiflsO 

Constrained least 
squares 

Minimize squared integral error over 
entire frequency range subject to 
maximum error constraints 

fircls(), firclsl () 

Arbitrary 

responses 

Arbitrary responses, including nonlinear 
phase and complex filters 

cfirpm() 

Raised cosine 

Lowpass response with smooth, 
sinusoidal transition 

firrcos() 


As discussed in Sect. 4.6, the phases of FIR filters having symmetric or anti¬ 
symmetric coefficients are linear so that the phase delay r p and group delay x g are 
equal and constant over the frequency band, where the phase delay and group delay 
are related to the phase shift 0(£2) = ZG(Q) of the frequency response as 


Table 7.2 shows some restrictions on the frequency response depending on the sym¬ 
metry of the FIR filter (tap) coefficients g[n] and whether the filter order is even or 
odd. Note that firl(N,fc,‘high’) and hrl(N,[fcl fc2], ‘stop’) with an odd filter order 
N design an (N + l)th-order HPF and BSF (of type I), respectively since no linear 
phase HPF or BSF of odd order (type II) can be made. 


Table 7.2 FIR filter design methods (see Sect. 4.6) 


Linear phase 
filter type 

Filter order N 

Symmetry of filter (tap) 
coefficients g[n ] 

Restriction on frequency 
response 

Type I 

Even 

Symmetric 

g\n] = g[N ~ n] 
forn = 0: N 

No restriction 

Type II 

Odd 

Symmetric 

g[n\ = g[N - n] 
forn = 0: N 

G(£2)| ft _ w = 0 
(No HPF or BSF) 

Type III 

Even 

Anti-symmetric 

g[n\ = —g[N - n] 
forn = 0: N 

G(Q) lo=o = 0, 

G(fi)|j2_ w = 0 

(No LPF or HPF or BSF) 

Type IV 

Odd 

Anti-symmetric 

gW = -g[N - n] 
forn = 0: N 

G(Q)| q=0 = 0 (No LPF) 
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7.2.2.1 Windowing Method 

Consider the frequency response of an ideal (“brick wall”) LPF with cutoff fre¬ 
quency £2 C as 


G/(£2) = Gj[ei a ] = (^ f" IS2-2»»|iS2. <*(»:»„ integer) (? 2 6) 
10 elsewhere 

Referring to Eq. (E3.5.2), we can take the inverse DTFT of this frequency response 
to write the impulse response of an ideal LPF as 

gi[n ] = ^{G,^)} ( = 3) ^ f ^ G(Q)e jnn d€l = ^sinc (7.2.7) 

Since this infinite-duration impulse response cannot be realized by a FIR filter, we 
apply a (rectangular) window of, say, length IV + 1 (N = 2M: an even number) to 
truncate it to make the tap coefficients of an N th-order FIR LPF as 

£2 e {£l c n\ N 

gLp[n] = gi[n]r 2M +dn + M] - —sine I ——I for — M <n < M(M = —) 

(7.2.8) 

We can multiply this with 2 cos (O p n) (for modulation) to obtain the tap coeffi¬ 
cients of an IVth-order FIR BPF with passband center frequency O p and bandwidth 
20 c as 


g B p[n ] = 2 g LP [n] cos(SVi) for - M < n < M(M = -) (7.2.9) 

We can also get the tap coefficients of N th-order FIR HPF (with cutoff fre¬ 
quency £2 f ) and BSF (with stopband center frequency £2 V and bandwidth 20.,) by 
subtracting the tap coefficients of LPF and BPF from the unit impulse sequence 
8[n] as 


(O c n\ 

gHp[n] = 5[n] — gLp[n] = 8[n\ -sine I -I for — M < n < M(M = N /2) 

(7.2.10) 

gBs\n] = <5[n] - g B p[n\ = <5[n] - 2g LP [n] cos(O s it) for - M < n < M(M = N /2) 

(7.2.11) 

where 8[n] is the impulse response of an all-pass filter with a flat frequency response 
(see Example 3.4). Note the following: 

- The tap coefficients or impulse responses of FIR filters (7.2.8), (7.2.9), (7.2.10), 
and (7.2.11) should be delayed by M — N/2 to make the filters causal for 
physical realizability (see Sect. 1.2.9). 
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- Cutting off the impulse response of an ideal filter abruptly for truncation results 
in ripples near the band edge of the frequency response. Thus a non-rectangular 
window such as a Hamming window is often used to reduce the Gibbs effect. 

Given a filter order N and description of the desired frequency response including 
6dB band edge frequency (vector), the MATLAB functions firl () and fir 2 () 
return the N + 1 tap coefficients of a FIR filter designed by the windowing method. 
Let us try using the MATLAB functions for FIR filter design in the following 
examples: 

Example 7.3 Standard Band FIR Filter Design 

Let us design several standard band FIR filters with sampling frequency F s = 50 
[kHz], The following program “sig07e03.m” finds the tap coefficients of an LPF 
with cutoff frequency 5kHz, a BPF with passband 7.5 ~ 17.5kHz, a HPF with 
cutoff frequency 20kHz, and a BSF with stopband 7.5 ~ 17.5kHz by using 
Eqs. (7.2.8), (7.2.9), (7.2.10), and (7.2.11) and the MATLAB function firl (). 
Fig. 7.16 shows the impulse responses (tap coefficients) and frequency responses of 
the filters obtained by running the program. 
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Ws= sum(fc_BS)/2*pi; % Stopband center frequency[rad/sample] 

fc_LP= (fc_BS (2)-fc_BS (1) )/2; gLP= fc_LP*sinc (fc_LP*nn) ; 

gBS= impulse_delayed-2*gLP . *cos (Ws*nn) ; % Eq. (7.2.11) 

gBSl=firl (N, fc_BS,'stop'); % filter impulse response/tap coefficients 

GBS= abs(freqz(gBS,1, W) )+eps; GBS1= abs(freqz(gBSl,1,W))+eps; 

subplot(427), stem(nnl,gBS), hold on, stem(nnl,gBSl,'r.') 

subplot(428), plot(fn,20*logl0(GBS), fn,20*logl0(GBSl),'r:') 


7.2.2.2 Multi-Band FIR Filter Design 

We can use the MATLAB function fir 1 (N, f, 'DC-1') or firl (N, f, 'DC- 
0') to design FIR filters whose frequency response magnitude is close to [1 0 1 
0 ...] or [0 1 0 1 ...] for each band [f(l) ~ f(2) f(2) ~ f(3) f(3) ~ f(4) f(4) ~ 
f(5)...] between the neighboring edge frequencies. We can also use the MATLAB 
function fir2 (N, f. A) or f irpm (N, f, A) or f iris (N, f, A) to design FIR 
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filters whose frequency response magnitude is close to an arbitrary piecewise linear 

shape specified by the second and third input arguments f and A. Note the following: 

- The firpm() function implements the Parks-McClellan algorithm, which uses the 
Remez exchange algorithm and Chebyshev approximation theory to design mini- 
max or equiripple filters minimizing the maximum error between the desired and 
actual frequency responses [W-3]. It yields the frequency response exhibiting an 
equiripple behavior. 

- The firls() function minimizes the integral of the squared error between the 
desired and actual frequency responses. 

- The number of desired frequency-amplitude points must be even for firpm() 
and firls(). 

- While the desired frequency response for firl() is supposed to be the brick wall 
type, firpm and firls() allow us to describe the desired frequency response so that 
we can insert the transition band(s) between the passband(s) and stopband(s) to 
reduce the ripple in the magnitude of the frequency response. 


Example 7.4 Multi-Band FIR Filter Design 

Figure 7.17 shows the impulse responses (tap coefficients) and frequency 
responses of the biters obtained by running the following program “sig07e04.m”. 
Especially, Fig. 7.17(b4) illustrates the difference between the magnitude responses 
of the equiripple and LSE biters that are designed using hrpm() and brls(), 
respectively. 
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%Multi-band pass/stop filter using firpm() 

B_firpm=firpm(N,ffd,GGd); % The number of frequency points must be even 
B_firls=firis(N,ffd,GGd); % The number of frequency points must be even 
G_firpm= freqz (B_firpm,1,W); 

G_firls= freqz (B_firis,1,W); 

subplot (427), stem (nnl, B_f irpm) , hold on, stem (nnl, B_f iris,) 
subplot (428) , plot (fn, abs (G_firpm) , fn, abs (G_firls) ,' r-.', f fd, GGd, ' k:' ) 



Fig. 7.17 Multi-band FIR filters designed using firl(), fir2(), and firpm()/firls() 


7.2.2.3 Anti-Symmetric FIR Filter Design 

We can use the MATLAB functions f irpm () or fir Is () with the fourth input 
argument ‘h’ or ‘d’ to design anti-symmetric FIR filters. Note that in the ‘d’ 
mode, f irpm () and f iris () weight the error by l/£2 and 1 /Q 2 , respectively 
in nonzero amplitude bands to minimize the maximum relative error or sum of rel¬ 
ative squared error. Note from Table 7.2 that the desired frequency response of an 
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anti-symmetric FIR filter of an even order should be allowed to be zero at £2 = 0 
and jt and that of an anti-symmetric FIR filter of an odd order should be allowed to 
be zero at £2 = 0. 

Example 7.5 Anti-Symmetric Filters - Hilbert Transformer and Differentiator 


(a)Hilbert Transformer 

The impulse response of the Hilbert transformer dealt with in Problems 2.10 
and 3.2 has an odd symmetry so that it can easily be designed using f irpm () 
or fir Is () with the fourth input argument 'h' as in the following program 
“sig07e05a.m”. We can run it to get Fig. 7.18, where the frequency response of 
the ideal Hilbert transformer is 


77(fi) (P = 1) { 7 

1+7 


for 0 < £2 < n 
for — n < £2 < 0 


(7.2.12) 


%sig07e05a.m 

% to design Hilbert transformers as anti-symmetric FIR filters 
% by using firpm() or firls(). 

fn=[0:512]/512; W= fn*pi; % normalized and digital frequency ranges 
% Hilbert transformer using firpm() or firls() 

% Type III (anti-symmetric and even order) with G(0)=0 and G(pi)=0 
B20_H_firpm= firpm(20,[0.05 0.95],[1 1],'h'); % Type III 
G20_H_firpm= freqz(B20_H_f irpm,1,W); 

B20_H_firls= firis(20, [0.05 0.95], [1 l],'h'); % Type III 
G20_H_firls= freqz(B20_H_f iris,1,W); 

% Type IV (anti-symmetric and odd order) with G(0)=0 
B21_H_firpm= firpm(21,[0.05 1],[1 l],'h'); % Type IV 
G21_H_firpm= freqz(B21_H_firpm,1,W); 

B21_H_firls= firls(21,[0.05 1],[1 1],'h'); % Type IV 
G21_H_firls= freqz(B21_H_f iris,1,W); 

subplot(421), nn=[0:20]; % Duration of filter impulse response 
stem(nn,B20_H_firpm), hold on, stem(nn,B20_H_firis,) 
subplot(422), plot(fn,abs(G20_H_firpm), fn,abs(G20_H_firls),':') 
subplot(423), nn=[0:21]; % Duration of filter impulse response 
stem(nn,B21_H_firpm), hold on, stem(nn,B21_H_firis,) 
subplot(424), plot(fn,abs(G21_H_firpm), fn,abs(G21_H_firis),':') 

% Use filter visualization tool to see the filter 
fvtool (B20_H_f irpm, 1, B20_H_f iris, 1) 
fvtool (B21_H_f irpm, 1, B21_H_firls, 1) 


(b)Differentiator 

The impulse response of the differentiator dealt with in Problem 3.3 has an odd 
symmetry so that it can easily be designed by using firpm() or firls () 
with the fourth input argument 'd' as in the following program “sig07e05b.m” 
where firpm () and firls () in the ‘d’ mode weight the error by 1/S2 and 
l/£2 2 , respectively. We can run it to get Fig. 7.19. 
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(Q)Why is the rightmost edge frequency in the second input argument of firpm()/firls() 
set to 0.95 instead of 1 for the type III FIR filter design despite the nonzero 
desired magnitude response at £2 = n ? 



I-.-^-.-- o'-•-•-•-•-1 

0 5 10 15 n 20 0 0.2 0.4 0.6 0.8 n/rr 1 

(al) Impulse response of a Hilbert transformer (bl) Magnitude response of a Hilbert transformer 
using firpmQ/firls (20, [0.05,0.95], [1 1], ’h') using firpm()/firls (20, [0.05,0.95], [1 1], 'h') 



0 5 10 15 n 2021 

(a2) Impulse response of a Hilbert transformer 
using firpm()/firls (21, [0.05,1], [1 1], 'h') 



Fig. 7.18 Hilbert transformers designed using firpmQ and firlsQ 



Fig. 7.19 Differentiators designed using firpm() and firls() 
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%sig07e05b.m 

% to design differentiators as anti-symmetric FIR filters 
% by using firpm() or firls(). 

fn=[0:512]/512; W= fn*pi; % normalized and digital frequency ranges 
% Differentiator using firpm()or firls() 

B20_d_firpm= firpm(20, [0 0.95], [0 0.95*pi],' d' ) ; % Type III 
G20_d_firpm= freqz (B20_d_f irpm, 1,W) ; 

B20_d_firls= firls(20, [0 0.95], [0 0.95*pi],'d'); % Type III 
G20_d_firls= freqz(B20_d_firls,1,W); 

B21_d_firpm= firpm(21,[0 1],[0 pi],'d'); % Type IV with G(0)=0 
G21_d_firpm= freqz(B21_d_firpm,1,W); 

B21_d_firls= firls(21, [0 1], [0 pi],'d'); % Type IV with G(0)=0 
G21_d_f irls= freqz(B21_d_firis,1,W); 

subplot(421), nn= [0:20]; % Duration of filter impulse response 
stem (nn, B20_d_f irpm) , hold on, stem (nn, B20_d_f iris, ) 

subplot (422) , plot (fn, abs (G20_d_f irpm) , fn, abs (G20_d_f iris) ) 
subplot(423), nn=[0:21]; % Duration of filter impulse response 
stem(nn,B21_d_firpm), hold on, stem(nn, B21_d_f iris,) 
subplot(424), plot(fn,abs(G21_d_firpm), fn,abs(G21_d_firis )) 

% Use filter visualization tool to see the filter 
fvtool (B20_d_f irpm, 1, B20_d_f iris, 1) 
fvtool (B21_d_f irpm, 1, B21_d_f iris, 1) 


7 . 2 . 2.4 Constrained Least Squares (CLS) FIR Filter Design 

There are two CLS filter design functions, fircls () and firclsl (). The 
fircls () function designs FIR filters whose magnitude responses are close to 
the desired piecewise constant one specified by a vector of band edges and the 
corresponding vector of band amplitudes. The upperbound and lowerbound of the 
desired magnitude response can also be given. The firclsl () function designs 
a FIR LPF or HPF whose magnitude response is close to the brick wall type for 
the passband/stopband specified by the cutoff frequency within the given tolerance 
on the passband and stopband ripples. Given the passband and stopband edge fre¬ 
quencies together with the weighting factor on stopband error relative to passband 
error, it applies the weighted least squares algorithm. In the case of HPF design, the 
filter order N given as the first input argument should be even; otherwise, it will be 
incremented by one to make an even filter order. 


Example 7.6 Multi-Band CLS FIR Filter Design 

The MATLAB function f i fc.ls () is used to design a two-band FIR filter with 
the desired magnitude response vector A = [0 0.5 0 1 0] for the bands speci¬ 
fied by the band edge vector f = [0 0.3 0.5 0.7 0.9 1] in the following program 
“sig07e06.m”. We run it to get Fig. 7.20, which shows the magnitude responses 
of the two filters where filter 1 and filter 2 are designed with the upperbound and 
lowerbound stricter on the stopband and the passband, respectively. 
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(a) Filter Visualization window opened by using fvtoolO (b) Analysis Parameters dialog box opened 

or clicking View/Filter-Visuali2ation-Tool on the top menu bar by clicking Analysis/Analysis Parameters 


Fig. 7.20 Multiband FIR filters designed using fircls(30,f,A,ub,lb) with f = [0 0.3 0.5 0.7 0.8 1] 
and A = [0 0.5 0 1 0] 


(cf) We can change the unit of magnitude and frequency scale in the Analysis 
Parameters dialog box opened by clicking Analysis/Analysis_Parameters on 
the menu bar of the Filter Visualization window. 


%sig07e06 .m 

% CLS design multi-band filters using fircls(). 
clear, refresh(1) 

N=50; % Filter order 

f= [0 0.3 0.5 0.7 0.8 1]; % The band edge frequency vector 
A= [0 0.5 0 1 0]; % The magnitude response vector 

ubl= [0.01 0.54 0.02 1.05 0.02]; lbl= [-0.01 0.46 -0.02 0.95 -0.02]; 

Bl_fircls= fircls(N,f,A,ubl,lbl); % stricter on stopband ripple condition 
ub2= [0.05 0.51 0.05 1.02 0.05]; lb2= [-0.05 0.49 -0.05 0.98 -0.05]; 

B2_fircls= fircls(N,f,A,ub2,lb2); % stricter on passband ripple condition 
fvtool (Bl_fircls,1, B2_fircls,1) %filter visualization tool to see filter 


Example 7.7 CLS FIR LPF/HPF Design 
(a)FIR LPF Dsign 

We can run the following program “sig07e07a.m” to get Fig. 7.21(a), which 
shows the magnitude responses of the two filters where filter 2 is designed with 
more weighting (Kw > 1) on the stopband. 
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(b)FIR HPF Dsign 

We can run the following program “sig07e07b.m” to get Fig. 7.21(b), which 
shows the magnitude responses of the three filters where filters 2 and 3 are 
designed with more weighting (Kw < 1) on the passband. Note that filters 2/3 
are ensured to satisfy the passband/stopband ripple condition at the frequency of 
ft = fp + 0.02/fs - 0.02, respectively. 




(a) The magnitude responses of FIR LPFs 
Fig. 7.21 FIR LPF/HPFs designed using firclsl () 


(b) The magnitude responsi 


7 . 2 . 2.5 Arbitrary-Response FIR Filter Design 

The c f i rpm () function designs a possibly nonlinear phase, asymmetric, complex- 
coefficient, and equiripple frequency response FIR filter minimizing the Chebyshev 
(or minimax) error between the actual magnitude response and desired one. Note 
the following: 

- B = cfirpm(N, f, A, w) returns a length (N + 1) FIR filter whose magnitude 
response is the best approximation to the desired frequency response described 
by f and A where 
N: the filter order. 
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f: the vector of (an even number of) band edge frequencies arranged in ascend¬ 
ing order between —1 and +1 where 1 is half the sampling frequency, 
i.e., the Nyquist frequency. The frequency bands span f(k) to f(k + 1) for 
k odd; the intervals f(k + 1) to f(k + 2) for k odd are “transition bands” or 
“don’t care regions” during optimization. 

A: a real vector (of the same size as f) which specifies the desired magnitude 
response as the line connecting the points (F(k),A(k)) and (F(k+1), A(k+ 
1)) for odd k. 

W: a vector of real, positive weights, one per band, for use during optimization. 
If not specified, it is set to unity. 

- For filters with a gain other than zero at Fs/2, e.g., highpass and bandstop filters, 
N must be even. Otherwise, N will be incremented by one. 

- B = cfirpm(N, f, {@fresp, pi, p2, • • •}, w) returns a length (N + 1) FIR filter 
whose magnitude is the best approximation to the desired frequency response as 
returned by function @fresp with optional arguments pl,p2, • • •. The function is 
called from within cfirpm() using the syntax [fg, wg] = fresp(N, f, fg, w, pi, p2, 

• • •) where 

fg: a vector of interpolated grid frequencies over each specified frequency band 
at which the response function will be evaluated. 

Ag and wg: the desired complex frequency response and optimization weight 
vectors, respectively, evaluated at each frequency in grid fg. 

- Predefined frequency response functions for @fresp include: 

‘lowpass’, ‘bandpass’, ‘hilbfilt’, ‘allpass’, ‘highpass’, ‘bandstop’, ‘differen¬ 
tiator’, ‘invsinc’ 

- B = cbrpm(- • • , Sym) imposes a symmetry constraint on the impulse response, 
where Sym may be one of the following: 

‘none’: Default if any negative band edge frequencies are passed, or if @fresp 
does not supply a default value of Sym. 

‘even’: Impulse response will be real and even. This is the default for highpass, 
lowpass, bandpass, bandstop, and multiband designs. 

‘odd’: Impulse response will be real and odd. This is the default for Hilbert and 
differentiator designs. The desired magnitude response at £2 = 0 must 
be zero. 

‘real’: Impose conjugate symmetry on the frequency response. 

(cf) If any Sym option other than ‘none’ is specified, the band edges should only 
be specified over positive frequencies; the negative frequency region will 
be filled in from symmetry. 

Example 7.8 Complex-Coefficient, Arbitrary Magnitude Response FIR Filter Design 
The MATLAB function cf irpm () is used to design two FIR biters with differ¬ 
ent biter order N = 30 and 40, with the desired piecewise linear magnitude response 
connecting the frequency-amplitude points {(—1,5), (—0.5,1), (—0.4,2), (0.3,2), 
(0.4, 2), (0.9, 1)} in the following program “sig07e08.m”. We run it to get Fig. 7.22, 
which shows the impulse and magnitude responses of the two biters. 
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Magnitude UnCs | L „ ea , [v| 

Magnitude Vector |[5 1 2221] | 


| OK | | Cancel | | Help | | Apply 

(c) User-defined Spectral Mask dialog box 
to the desired magnitude response 


(cf) To plot the desired magnitude response curve 
so that it will be overlapped with the actual one 
of the designed filter dotted, type in the band 
edge frequency vector and the corrresponding 
desired magnitude response vector into the 
dialog box opened by clicking the View/User- 
defined Spectral Mask menu on the top menu bar. 


Fig. 7.22 Complex impulse response and frequency response of (nonlinear phase) FIR filters 
designed using cfirpm() 
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7.2.3 Filter Structure and System Model Available in MATLAB 

Figure 7.23 shows various filter structures that can be constructed, realized, and cast 
into a Simulink block by using FDATool or the dfilt()/realizemdl() command (see 
Sect. E.15). Note that all of the (transposed) direct I and II forms in Fig. 7.23(a)-(d) 
commonly have the following system function 
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MATLAB represents the SOSs (second-order sections) connected in cascade 
(with the output of each stage applied into the input of the next stage) as an M x 6 
array ‘SOS’, each row of which contains the numerator and denominator coefficient 
vector [b m \ b m 2 b m 3 1 a m 2 a m 3] of a single section. 

MATLAB provides several functions that can be used for conversion between 
the various linear system models as listed in Table 7.3. Converting from one system 
model or filter structure to another may yield a result with different characteristic 
than the original due to the computer’s finite-precision arithmetic operations and the 
variations in the conversion’s round-off computations. 






Table 7.3 MATLAB functions for conversion between the various linear system models 



System Function 

State- 

Space 

Zero-Pole-Gain 

SOS (cascade) 

SOS (parallel) 

Lattice 

System Function 

_ 

tf 2s 

S () 

tf2zp() 

tf2sos() 

tf 2par_z () * 

tf21atc() 

State-Space 

ss2tf () 

— 


ss2zp () 

ss2sos () 

None 

None 

Zero-Pole-Gain 

zp2tf () 

z P 2s 

S 0 

— 

z P 2sos () 

None 

None 

SOS (cascade) 

sos2t C () 

sos2 

ss() 

sos2zp() 

— 

None 

None 

SOS (parallel) 

parg%,§ () * > 

None 


None 

None 

— 

None 

Lattice 

latc2tf() 

None 


None 

None 

None 

— 


(cf) * means that the MATLAB function is fabricated in this book. 
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In the Filter Design & Analysis window (Fig. 7.24(a)) opened by typing ‘fdatool’ 
in the MATLAB command window, we can convert the structure of a designed 
filter through the Convert Structure dialog box (Fig. 7.24(bl)) opened by clicking 
Edit/Convert Structure (Fig. 7.24(b)) on the top menu bar. The following structures 
are available for conversion in MATLAB: 

- Direct form I, Direct form II, Direct form I transposed, or Direct form II 
transposed 

- Second-Order Sections 

- Lattice minimum/maximum phase from minimum/maximum-phase FIR filter 

- Lattice allpass from Allpass filter 

- Lattice ARMA from HR filter 

- State-Space model 

The MATLAB function dfilt() can also be used to convert the filter structure. For 
example, 

»B=firls (30, [0 .5 .6 1] , [0 0 1 ,1,| Bdl-dfilt. df fir (B) ; %direct-form FIR 

>> [B, A] =butter (7,0.2) ; Gd2=dfilt.df2tsos (tf2sos (B,A) ) ; %direct Ilt-SOS HR 
»Gd_par-df ilt . parallel (Gdl, Gd2 ) ; %parallel structure of two or more objects 
»realizemdl (Gd.par) % To create Simulink model 
»fvtool (Gdl,Gd2,Gd_par) % to analyze filter 

7.2.4 Importing/Exporting a Filter Design 

In the FDATool window (Fig. 7.24), we can click the Import Filter button in the side 
bar to open the Import Filter panel (Fig. 7.25) and import a filter in any of the repre¬ 
sentations in the Filter Structure or a SOS by clicking on the check box. In the fields 
of Numerator and Denominator, type the filter coefficient vectors explicitly or the 
names of the variables whose values are in the MATLAB workspace. Then select 
the frequency unit from the options in the Units menu and if the selected frequency 
unit is not ‘Normalized’, specify the value or MATLAB workspace variable of the 
sampling frequency in the Fs field. Lastly click the Import Filter button at the bottom 
of the Import Filter panel to import the filter that you have specified. You can edit 
the imported filter using the Pole/Zero Editor panel in which you can move poles, 
add, or delete poles/zeros. 

On the other hand, we can select the File/Export menu in the FDATool window 
to open the Export dialog box (Fig. 7.26) and save your filter design result by 

- exporting the filter coefficients or objects to the workspace, a MAT-file, or a C 
header file, 

- exporting the filter coefficients to an ASCII file, 

- or exporting to SPTool or Simulink. 


(cf) FDATool GUI is opened through the Digital Filter Design block in the Signal 
Processing Blockset. 













































Fig. 7.26 Exporting a filter design result 

7.3 How to Use SPTool 

SPTool is an interactive GUI for digital signal processing that can be used to 

- Analyze signals (Signal Browser) 

- Design filters (FDATool: Filter Design & Analysis Tool) 

- Analyze (view) filters (FVTool: Filter Visualization Tool) 

- Filter signals 

- Analyze signal spectra (Spectrum Viewer) 

Signals, filters, and spectra can be brought from the MATLAB workspace into the 
SPTool workspace using File/Import. Signals, filters, and spectra created/modified 
in or imported into the SPTool workspace can be saved (as MATLAB structures) 
using File/Export. 

Figure 7.27(a) shows the SPTool window opened by typing ‘sptool’ into the 
MATLAB command window where you can access the three GUIs, i.e., Signal 
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Browser (Fig. 7.27(b)), Filter Visualization Tool (Fig. 7.20(a)), and Spectrum Viewer 
(Fig. 7.27(c)) by selecting a signal, filter, or spectrum and clicking the appropriate 
View button. Note that if you start FVTool by clicking the SPTool Filter View button, 
FVTool is linked to SPTool so that any changes made in SPTool are immediately 
reflected in FVTool where the FVTool title bar includes “SPTool” to indicate the 
link. (Every time you click the Filter View button, a new, linked FVTool starts, 
which allows you to view multiple analyses simultaneously. Any parameter except 
the sampling frequency can be changed in a linked FVTool. The sampling frequency 
can be changed through the Sampling Frequency dialog box opened by selecting the 
Edit/Sampling ^Frequency menu in the SPTool window or by selecting the Analy- 
sis/Sampling_Frequency menu in the FDATool window, which will be opened by 
clicking the Filters/Edit button.) If you start an FVTool by clicking the New button 
or by selecting File/New from within FVTool, that FVTool is a stand-alone version 
that is not linked to SPTool. You can also access a reduced version of FDATool 
(Fig. 7.24(a)) by clicking the New button to create a new filter or the Edit button to 
edit a selected filter. You can apply a selected filter to a selected signal by clicking 
the Apply button. Clicking the Create button opens the Spectrum Viewer and shows 
the PSD (power spectral density) of the selected signal. Clicking the Update button 
opens the Spectrum Viewer for the selected spectrum. 

Let us try using the SPTool in the following steps: 

1. Create a noisy two-tone signal in the MATLAB workspace and import it into 
SPTool. 

2. Design a BPF using FDATool. 

3. Apply the designed filter to the signal to create a bandlimited noisy signal. 

4. Analyze the input and output signals. For example, you can compare the original 
and filtered signals in the time domain using the Signal Browser. 

5. Compare the original and filtered signals in the frequency domain using the 
Spectrum Viewer. 

6. Save the filter design and signal analysis results by exporting to disk (MAT-file) 
or workspace. 

<Step 1: Creating a noisy signal in the MATLAB workspace and importing it 
into SPTool > 

You can type the following statements into the MATLAB command window: 

»Fs=le4; Ts=l/Fs; : 0.5] ; randn (' state', 0:} } 

»x=sin (2*pi*941*tt) +cos (2*pi*1209*tt) +0 . l*randn (size (tt) ) ; 
»sptool % Open a SPTool window to start a new SPTool session 

Then in the SPTool window, select the File/Import menu to open the Import- 
to-SPTool dialog box in which you can import x and Fs into the SPTool in 
the following way (see Fig. 7.28(a)): 

- Select x from the Workspace Contents list, click the upper Right-Arrow 
button, and name the signal by typing, say, ‘sigl’ (default name) in the 
Name field to import x as a signal data. 
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- Select Fs from the workspace contents list and click the lower Right- 
Arrow button to import Fs as the sampling frequency. 

- Click the OK button to close the Import-to-SPTool dialog box. Then you 
will see sigl[vector] in the SPTool’s Signals list (see Fig. 7.29(a)). 

(cf) You can also import signals from MAT-files on your disk. 

(cf) You can import filters and spectra into SPTool in the same way as you 
import signals. 

<Step 2: Using FDATool to design a BPF> 

You might import an existing filter or design/edit a new filter using FDATool. 
Here, click the New button to open FDATool, type the following specification 
into the appropriate fields, and then click the Design Filter button to design a 
filter named ‘filtl’ by default (Fig. 7.28(b)): 

Sampling frequency: Fs = 10kHz, Stopband attenuation: A s = 50dB, and 
Passband ripple: R p — 3dB 

Passband edge frequencies: f p \ — 1.1 kHz, f p 2 = 1.8 kHz 
Stopband edge frequencies: f s \ — 1 kHz, f s 2 = 2kHz 

<Step 3: Applying the designed filter to the signal to create a bandlimited 
signal > 

- Select the signal ‘sigl[vector]’ from the Signals list by clicking on it 
(Fig. 7.27(a)). 

- Select the filter ‘filtl [design] ’ from the Filters list by clicking on it. 

- Click the Apply button under the Filters list to open the Apply Filter dialog 
box (Fig. 7.28(c)), in which you can select the filtering algorithm, name 
the output signal, say, ‘sig2’, and click OK to close the dialog box. Then 
you will see sig2[vector] in the SPTool’s Signals list. 

(cf) If you see a warning message that the sampling frequencies for the sig¬ 
nal and filter are different, select the Edit/Sampling_Frequency menu to 
make them equal and then apply the filter to the signal 
(Fig. 7.28(d)). 


<Step 4: Comparing the original and filtered signals in the time domain in 

Signal Browser> 

- Select the signals ‘sigl’ and ‘sig2’ from the Signals list by (Shift/Ctrl+) 
clicking on them. 

- Click the View button under the Signals list to open the Signal Browser 
window and see the two signals in the time domain. 

- If needed or desired, you can click the Select Trace button to select one of 
the displayed signals and then click the Line Properties button to change 
the color and/or line style to display the selected signal. 
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You can also click the Play_Selected_Signal button to play the selected sig¬ 
nal. You can click the Vertical-Markers button to use the vertical Markers 
to select a portion of the signal you want to play. If you want to print the 
signals (or their spectra), click the Print button. 


<Step 5: Compare the original and filtered signals in the frequency domain in 
Spectrum Viewer > 


In the SPTool window (Fig. 7.29(a)), select the signal ‘sigl[vector]’ from 
the Signals list by clicking on it. 

Click the Create button under the Spectra list to create a PSD ‘spectl’ 
corresponding to the selected signal ‘sigl’ and open the Spectrum Viewer 
window (Fig. 7.29(bl)). Note that the PSD is not yet computed and 
displayed. 

Through the Parameters region, set the parameters such as the spectral 
analysis method (Welch), FFT size (Nfft = 1024), window size (Nwind = 
1024), Window type (hanning), and Overlap length (512). 

Click the Apply button in the Spectrum Viewer window to compute and 
display the PSD spectl. 

Follow the above three steps for the filter output signal ‘sig2’ to create 
another PSD, say, spect2. In the Parameters region, you had better select 
‘spectl’ from the PSD list in the Inherit_from field (Fig. 7.29(b2)) so that 
every spectral analysis parameter can be inherited from the existent PSD 
‘spectl’. 

You can Shift + click on ‘spectl’ and ‘spect2’ in the Spectra list to select 
them and click the View button under the Spectra list to reactivate the 
Spectrum Viewer and display the two spectra together. 

You can export the signals, filters, and spectra through the Export_from_ 
SPTool dialog box opened by selecting the File/Export menu. 


<Step 6: Save the filter design and signal analysis results> 

You can save the designed filter(s) and signal analysis result(s) by exporting 
on your disk (as a MAT-file) or the MATLAB workspace in the follow¬ 
ing way: 


In the SPTool window, select the File/Export menu to open the Export- 
from-SPTool dialog box in which you can select the signals, filters, 
and spectra you want to save from the Export list and save them on 
your disk (as a MAT-file) or the MATLAB workspace by clicking the 
Export to Disk or Export to workspace button, respectively (see Fig. 7.30). 
If you have exported the filter structure ‘filtl’ into the workspace, you can 
refer to its numerator and denominator as ‘filtl.tf.num’ and ‘filtl.tf.den’. 
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-) Export from SPTool 


Signal: mtlb [vector] HTI 
Signal: chirp [vector] r—1 
Signal: train [vector] 


Signal: sig2 [vector] 
Filter: LSlp (design] 
Filter: PZlp [imported]! 
Filter: FIRbp [design] | 



□ Export filters as TF objects 

c~ 


Export to disk... 


Export to workspace 


Fig. 7.30 Export _from_SPTool dialog box 


Problems 

7.1 Design and Use of a Filter to Remove/Reduce a Noise from a Music Signal 

(a) Using any recording software, create a wave file of sampling frequency 
8kHz, duration 16 s, and any melody that you like in the name of, say, 
“melody.wav”. Then take the following steps: 

(1) Use the MATLAB command ‘wavreadO’ to extract the signal vector 
x and sampling frequency Fs from the wave file. Use ‘soundscO’ to 
listen to the melody signal. Use ‘fft()’ & ‘plot()’ to plot x together with 
the magnitude of its DFT spectrum in dB. 

(2) Add a noise of amplitude 0.5 and frequency 3.9kHz to the signal, listen 
to the noise-contaminated signal xn, and plot xn together with its DFT 
spectrum magnitude in dB. 

(3) Design a Butterworth LPF with passband/stopband edge frequencies 
of 3.6kHZ/3.9kHz and use the LPF to filter the noise-contaminated 
signal to obtain a filtered signal xf. Then listen to the filtered signal xf 
and plot xf together with the magnitude of its DFT spectrum in dB. 
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%test_filtering.m 

[x,Fs]=wavread('melody.wav'); 

soundsc(x,Fs); 

Ts=l/Fs; t=(0:N-1)*Ts; nn=l:N/32; tt=t(nn); % time vector 
subplot (4,2,1), plot(tt,x (nn)), axis([tt([l end]) -2 2]) 
xlabel('time[s]'), ylabel('signal x[n]') 

X=fftshift(fft(x,N)); X_mag=20*logl0(abs([X X(l)])); 
f=(-N/2:N/2)*(Fs/N); fkHz=f/1000; % frequency vector 
subplot (4,2, 2) , plot (fkHz, X_mag) , axis ([-5 5 -40 100]) 
xlabel('f[kHz]'), ylabel('20*logl0|X(k)|[dB]') 

% Add a High Frequency Noise 

omega=2*pi*3900*Ts; % convert 3.9 kHz into digital (DT) frequency 
%omega=2*pi*5000*Ts; % convert 5 kHz into digital (DT) frequency 
n=0:N-l; noise=0.5*cos(omega*n); xn = x + noise; soundsc(xn,Fs); 
subplot(4,2,3), plot(tt,xn(nn)), axis([tt([l end]) -3 3]) 
xlabel('time[s]') , ylabel('noise-contaminated signal xn[n]') 
Xn=fftshift(fft(xn,N)); Xn_mag=20*logl0(abs([Xn Xn(l)])); 
subplot (4,2,4), plot(fkHz,Xn_mag) , axis ([-5 5 -40 100]) 
xlabel('f[kHz]'), ylabel('20*logl0|Xn(k)|[dB]'), 

% Butterworth LPF Design 

Rp=3; As=40; % Passband Ripple and Stopband Attenuation in dB 
fp=3600*Ts*2> fs=3900*Ts*2; % passband/stopband edge frequency 
[Nb,fcb]=buttord(fp,fs,Rp,As); 

[Bb,Ab]=butter(Nb,fcb); 

H=fftshift(freqz(Bb,Ab,N,'whole')); Hjnag=20*logl0(abs([H; H (1)])); 
subplot (4,2, 6) , plot (fkHz, H_mag) , axis ([-5 5 -100 5]) 
xlabel('f[kHz]'), ylabel('20*logl0|H(k)|[dB]'), 

% Filtering to remove the 10kHz noise 
xf=filter(Bb,Ab,xn); soundsc(xf,Fs); 

subplot (4,2,7), plot(tt,xf(nn)), axis([tt([l end]) -2 2]) 
xlabel('time[s]'), ylabel('filetred signal xf[n]') 

Xf=fftshift(fft(xf,N)); Xf_mag=20*logl0(abs([Xf Xf(l)])); 
subplot (4,2,8) , plot (fkHz,Xf_mag) ; axis ([-5 5 -40 100]) 
xlabel('f[kHz]'), ylabel('20*logl0|Xf(k)|[dB]'), 


(b) Referring to Fig. P7.1, make a Simulink model file to perform the filtering 
operation as done by the above MATLAB program “testJiltering.m”. You 
can relocate the To JWave JDevice block to listen to the original signal, the 
noise-contaminated one, and the filtered one. 
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Fig. P7.1 Simulink block diagram for a signal filtering and the parameter setting dialog boxes for 
spectrum scope block 
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State Space Analysis of LTI Systems 
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In this chapter we will introduce the state space description of a system, which 
consists of the state and output equations. It has several distinct features compared 
with the transfer function approach: 

- It allows us to deal with multi-input multi-output (MIMO) systems in a system¬ 
atic way. 

- It describes a system more completely than the transfer function does. It describes 
not only the input-output relationship, but also what is happening under any ini¬ 
tial condition, while the transfer function covers only systems with zero initial 
condition. 

- It can be applied to certain types of nonlinear and/or time-varying systems. 

- It is not easy to determine the state equation through experiments, while the trans¬ 
fer function of an LTI system can be measured by employing signal generators 
and spectrum analyzer. 


W.Y. Yang et al., Signals and Systems with MATLAB®, 

DOI 10.1007/978-3-540-92954-3 _8, © Springer-Verlag Berlin Heidelberg 2009 
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State Space Analysis of LTI Systems 


8.1 State Space Description - State and Output Equations 


In this section we introduce the state space description of an N th order LTI system, 
which consists of a set of equations describing the relations among the input, output, 
and state: 


State equation: 


x'CO = /<*(#), U(r), o 
(8.1.1a) 


x[n + l] = f(x[n],u[n],n) (8.1.1b) 


Output equation: y (t) = g(x(t), u(t), t) 
(8.1.2a) 


y[n] = g(x[n],u[n],n) (8.1.2b) 


where 


State vector: 

x(t) = [Xi (t), •• 

• ,x N (t)] T 

x[n] 

= [xi[n], ■ 

•• -x N [n]] T 

Input vector: 

U(f) = [«!(/), • • 

■ , u K (t)f 

u [n] 

= [u\[n\, ■ 

■■ ,u K [n]] r 

Output vector: 

y(0 = [yi(0. 

■ , yu(t)] T 

ylnl 

= pi[n], ■ 

■ ■ , yuin}? 


(cf.) Note that, in this chapter, the notation u(t)/u[n] denotes the general input 
function, while the unit step function/sequence is denoted by u s (t)/u s [n]. 


Here, we have the definitions of the state and the state variable: 


Definition 8.1 State, State Variables, and State Vector 

The state of a system at time to is the amount of information at to that, together with 
the input from to, determines uniquely the behavior of the system for all t > to- Note 
that the ‘behavior’ means all the responses, including the state, of the system. 

The state variables of a dynamic system are the variables forming the smallest set 
of variables which determine the state of the system. The state vector is composed 
of the state variables. 


(Ex) For an RLC circuit driven by a source e(t), the inductor current i/.(t) and 
capacitor voltage vc(t ) can form the state. The charge qc(t) and inductor cur¬ 
rent fz,(t) can also make the state. It is because {iift), Vc(t)} or {qc(t), lift)) 
can be determined for any t > to if the value of input e(t) is known for t > t 0 
together with the initial condition {i L (t 0 ), uc(to)} or {qc(k>), iifk)]. 

(Ex) For a moving body, the set of the position x(t) and velocity x'(t) qualifies the 
state of the mechanical system since the information about x(to), x'(?o), and 
u(t) (force) for t > to is necessary and sufficient for determining x(t) and x'(t) 
for any time t > to- 


Especially, the state space descriptions of continuous-time/discrete-time LTI sys¬ 
tems are 




8.1 State Space Description - State and Output Equatk 
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State equation: x'(f) = Ax(t) + Bu(t) \[n + 1] = Ax[«] + #u[n] (8.1.3b) 

(8.1.3a) 

Output equation: y(t) = Cx(t) + Du(t) y[«] = Cx[n] + Z)u[n] (8.1.4b) 
(8.1.4a) 

In Sect. 1.3.4, we illustrated how a continuous-time/discrete-time state diagram 
can be constructed for a given differential/difference equation. Once a state dia¬ 
gram is constructed, the corresponding state equation can easily be obtained by the 
following procedure: 


1. Assign a state variable xftA/xfn] to the output of each integrator ,v ’/delay 

z _1 . 

2. Write an equation for the input x' i (t)/x i \n + 1] of each integrator/delay. 

3. Write an equation for each system output in terms of state variables and 
input(s). 


Applying this procedure to the state diagrams in Figs. 1.19(a)/!.20(c) yields 



which is referred to as the controllable canonical form. Also, for Figs. 1.19(b)/l .20(d), 
we obtain 



which is referred to as the observable canonical form. 

(cf.) Note that the controllable and observable canonical forms of state/output 
equations are convenient for designing a controller and an observer, respec¬ 
tively. [F-l] 
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8.2 Solution of LTI State Equation 
8.2.1 State Transition Matrix 

For later use, we will define the continuous-time/discrete-time LTI state transition 
matrices and examine their properties. 

Definition 8.2 LTI State Transition Matrix - Fundamental Matrix 
For an LTI system described by the state equations (8.1.3a)/(8.1.3b), the LTI state 
transition matrix or fundamental matrix 0(f)/0[n] is an N x N matrix, which is 
multiplied with the initial state x(0)/x[0] to make the state x(f)/x[n] at any time 
t/n >0 as 

x(f) = 0(f)x(O) | x[n] = 0[n]x[0] 

and satisfies the homogeneous state equation with zero input 

x'(f) = Ax(f) x[n + 1] = Ax[n] 

; 4>'{t)x{ 0) = A0(f)x(0) ; (p[n + l]x[0] = A<j)[n]x[ 0] 

; 0'(f) = A0(f) (8.2.1a) ; 0[n +1] = A0[n] (8.2.1b) 

where the initial condition is 0(O)/0[O] = / (an N x N identity matrix). 

To find 0(f), we make use of Tables A.2(5)/B.7(2) (with n\ — 1) to take the 
(unilateral) Laplace/z -transform of both sides of Eqs. (8.2.1a)/(8.2.1b) as 

s<t>(s) — 0(0) = A<h(s) | z4>[z] - z0[O] = A4>[z] 

and solve this for 4>(s)/ct>[z] as 

4>(s) = I ~ A] _1 0(O) = [si - A]" 1 <D[z] = [zl - A]-'z0[O] = [zl - A]-‘z 

= [/ - As" 1 ]- 1 *- 1 =[l-z~ 1 A]- 1 

= Is~ l + As -2 + A 2 s~ 3 + ■■■ =1 + Az~ x + A 2 z~ 2 + • • • 

Now we use Table A.l(4)/Eq. (4.1.1) to take the inverse transform of <E>(s)/<t>[z] 
to get 

0(f) = £ _1 {<t'(s)} = C~ l [[sl - A]" 1 } 0[n] = ^-‘{^[zll = Z~ l [[zl - A] _1 z} 

A 2 , = A" (8.2.2b) 

= I + At + —t 2 +---=e A ‘ 

(8.2.2a) 

which is the continuous-time/discrete-time LTI state transition or fundamental 
matrix. This result can be verified by substituting Eqs. (8.2.2a)/(8.2.2b) into 
Eqs. (8.2.1a)/(8.2.1b), respectively. 
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The LTI state transition matrices possess the following properties: 

<Properties of the LTI state transition matrix> 

1 ) 4>{ti)<t>{t 2 ) = 4>{h + h) v ti,t 2 I 1 ) </>[«! M«2] = 0[«1 + ri 2 \ v n u n 2 

2) <K-t) = 0(0) = / 2) 4>[-n] = <t>~ l [n]-, 0[O] = / if 0[n] 

3) 0(t) = e At is nonsingular V t < oo | is nonsingular. 


8.2.2 Transformed Solution 

To solve the LTI state equations (8.1.3a)/(8.1.3b), we make use of Tables A.2(5)/ 
B.7(2) (with m = 1) to take the (unilateral) Laplace/z -transform of both sides 
and write 

sX(s) - x(0) = AX(s) + BU(s) I zX[z] - zx[0] = AX[z] + BU[z] 

; [si - A]X(s) = x(0) + BU(s) ; [zl - A]X[z] = zx[0] + BU[z] 

which can be solved for X[s)/X[z\ as 

X(s) = [si - A] _1 x(0) I X[z] = [zl - A] 'cx|0] 

—[.v/ - AT l BU(s) (8.2.3a) +[zl - A]~ l BU[z] (8.2.3b) 


Now, we will find the inverse transform of this transformed solution: 

x{t) = C~ l [[sl - A] -1 }jf(0) x[n] = Z '[[zl - AJ-'zJxtO] 

+ £ '{[-v/ - A\ 'BU{s)[ + Z~ l [[zl - A]~ l BU[z]} 

(8.2.4a) (8.2.4b) 

We can use Eq. (8.2.2), the convolution property, and the causality assumption 
to write 



Substituting Eqs. (8.2.5) and (8.2.6) into Eq. (8.2.4) yields the solution of the LTI 
state equation as 
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x(f) = e Ar x(0) + 

= mm 


Jo 

('«- 

Jo 


t)Bu(t)cIt 

(8.2.7a) 


x[n] =A"x[0] + Y^' m l -o An ~ l ~ mBu[m] 
= 0[«]x[O]+ 

Y. <p[n — 1 — m]Bu[m] 

(8.2.7b) 


which is referred to as the state transition equation. Note that, if the initial time is 
to/no, then we will have 


x(f) = e M ‘ <o) x(f 0 ) + J' e f 
= 0(t - fo)x(to) + J 


4(< x) Bxx{x)dr 
4>{t — r)fiu(t)dt 


(8.2.8a) 


x[n] =A" "°x[n 0 ] + Y m -„ A " * 

= <t>[n - n 0 M«o]+ 

~ 1 _ m ^ BU ^ 

(8.2.8b) 


Example 8.1 Solving a State Equation 

(a) Consider a continuous-time LTI system described by the following differential 
equation: 


f(t) + y'(t) = u(t) (E8.1.1) 

Applying the procedure illustrated in Sects. 1.3.4 and 8.1, we can write the state 
equation as 


where 



(E8.1.2) 

(E8.1.3) 


A = 


C = [ 1 0], D = 0 


Thus we have 


,r [s oi ro ill 1 [ s -ii 1 

[sI A] _ |_|_0 sj [0-1JJ _ [o s + l_ 


~ 1 -(s +1 r 1 ' 

c* + l )” 1 


1 [s+ 1 1 

s(s + 1) L 0 * 

(E8.1.4) 
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so that the state transition matrix is 

- Ar 'Ct<«[i 1 7->1 for ' - 0 <E8 L5) 

Therefore, from Eq. (8.2.7a), we can write the solution of the state equation as 

(E8.1.6) 

(b) Consider a discrete-time LTI system described by the following state equation: 

ywk|l0]|^["j] (E8.1.8) 

where 

aB =[ r 7_^" r ]. cfeji o], o=o 

For this system, we have 

for i + 


r 1 41-1 \l z Tl 1 - e T l] 

[Zi-A] z= [ 0 Z J -|_ 0 ^ J 2 


(z - l)(z - e ~ T ) 


Jz-e l-e 

I 0 z 1 


<e8l< 

te transition matrix is 

= b) Z~ l {[zI - AV'z] <E = 9) \l 1 ~-nT H forn > 0 (E8.1.1C 

B.8(3),(6)[0 e nl \ 


so that the state transition matrix is 
<j)[n] 


as would be obtained from <p[n ] (8 = A". Therefore, from Eq. (8.2.7b), we can 
write the solution of the state equation as 

rx![n]] (8.z7b) n 1 - «-»n r x m] yi rr - a - .-^-i-on 
\x 2 [n\\ (E8.1.10) [o e nT \ |_x 2 [0]J 2-, [ (l-e T )e 1 m)T \ 


(E8.1.11) 
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8.2.3 Recursive Solution 

The discrete-time state equation has a recursive form and therefore is well-suited 
for a digital computer, which can be programmed to perform the following compu¬ 
tation: 

x[l] = Ax[0] + flu[0] 

x[2] = Ax[l] + Bu[l] = A 2 x[0] + AZ?u[0] + Bu[l] 

x[3] = Ax[2] + Bu[2] = A 3 x[0] + A 2 Bu[0] + Aflu[l] + flu[2] (8.2.9) 


x[n] = A"x[0] + Yl" \ A"- l - m Bu[m] 

If the continuous-time state equation is somehow discretized, it can be solved 
recursively, too. 


8.3 Transfer Function and Characteristic Equation 
8.3.1 Transfer Function 

Using the transformed solution (8.2.3) of the state equation, we can write the 
transform of the output equation (8.1.4) with zero initial condition as 


Y (.y j = CX(s)+DU(s ) 

^Clsl - A]~ 1 BU(s) + DU{s) 
(8.3.1a) 


Y[z] = CX[z ] + DU[z] 

(8 '= b) _ A] -i BU[z] + DU{z] 

x[„]=0 

(8.3.1b) 


Thus the transfer function matrix describing the input-output relationship turns out 
to be 

G(s) = C[sI- A]~ l B + D (8.3.2a) | G[z] = C[zl - A]~ l B + D (8.3.2b) 

Taking the inverse transform of this transfer function matrix yields the impulse 
response matrix : 


g(t) = C(j){t)B + DS(t ) (8.3.3a) | g[n] = C<fr[n - 1]B + DS[n] (8.3.3b) 
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8.3.2 Characteristic Equation and Roots 

Note that the transfer function matrix (8.3.2) can be written as 


G(s) = C 


Adj [si - A] 
\sI~A\ 


B + D (8.3.4a) 


G[z] = C 


Adj [zl - A] 
\zl — A\ 


B + D 


(8.3.4b) 


where Adj[.v / — A] denotes the adjoint, i.e., the transpose of the cofactor matrix. 

The characteristic equation of an LTI system is obtained by equating the denom¬ 
inator of the transfer function to zero: 


\sl — A| = 0 (8.3.5a) | |z/-A|=0 (8.3.5a) 


Therefore, the roots of the characteristic equation are the eigenvalues of the matrix A 
and are often called the characteristic roots of the system. The physical implication 
of a characteristic root so/zo is that there will appear such terms as Ke s °‘/K(zo) n in 
the natural response of the system. 

(cf.) The natural response means the output stemming from the initial condition, 
while the forced response means the output caused by the input. 


Example 8.2 Transfer Function 


(a) For the continuous-time LTI system described by Eq. (E8.1.2) in Example 8.1(a), 
we can use Eq. (8.3.2a) to find the transfer function 


g(s)^c[si-a]~ 1 b + d = [ i 0]^] p] 

[i Q] p + i i]ro] = i 

s(s +1) L ° s ] W s ( s + 1) 


(E8.2.1) 


This could be obtained directly by taking the transform of the differential equa¬ 
tion (E8.1.1). We can equate the denominator of this transfer function with zero 
to write the characteristic equation 


\sl - A\=s(s+l) = 0 (E8.2.2) 


which has the roots s = 0 and s = — 1 as the eigenvalues. 

(b) For the discrete-time LTI system described by Eq. (E8.1.7) in Example 8.1(b), 
we can use Eq. (8.3.2b) to find the transfer function 
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G[z] ( *'= b) C[zl - A]- 1 B + D = [ 1 ( 

[1 0] \z-e~ T 

(z - l)(z - e~ T ) L 0 
_ (T - 1 + e~ T )z + 1 - e~ T - 
(z - l)(z - e~ T ) 

We can equate the denominator with zei 
\zl — A\—{z — 
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(E8.2.3) 


to write the characteristic equation 
(z - e~ T ) = 0 (E8.2.4) 


which has the roots z = 1 and z, = e 1 as the eigenvalues. 


8.4 Discretization of Continuous-Time State Equation 

In Chap. 6, we studied various discretzation methods that can be used for converting 
a given s -transfer function or a differential equation into an ‘equivalent’ z -transfer 
function or a difference equation. In this section, we will develop a technique to 
discretize a continuous-time state equation into an ‘equivalent’ discrete-time state 
equation. 

8.4.1 State Equation Without Time Delay 

Let us consider a continuous-time state equation 

x'(t) = Ax(t) + Bu(t) (8.4.1) 

y(t) = Cx(t) + Duif) (8.4.2) 

As shown in Sect. 8.2.2, the solution to these equations is given by Eq. (8.2.8a): 

x{t) = 4>{t - io)x(io) + J 4>{t - T)Bu{x)dx (8.4.3) 

To obtain an ‘equivalent’ discrete-time state equation, we write the state transition 
equation for an interval of sampling period T from t 0 = nT to t = (n + 1 )T: 

f(n+W 

x((n + l)r) = <t>(T)x{riT) + J cj)(nT + T — x)Bu{x)dx (8.4.4) 

Assuming that the input is constant dining each sampling interval, i.e., u(t) = 
u{nT) = u[n ] for nT <t<(n+ 1 )T, we can rewrite this equation as 
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x[n + 1] = 0(T)x[n] + J <p(nT + T- z)dzBu[n] 

; x[n + 1] = A D x[n\ + B D u[n] (8.4.5) 

where we have let x(nT ) = x[n], u(nT ) = u[n ], and 

A d = 4>{T) = e AT (8.4.6a) 

f (n+l)T nT+T-r^a f T 

B d = <!>(nT + T -z)dzB = - 4>(a)daB = I <j)(z)dzB 

(8.4.6b) 


We can get the discrete-time system matrices A D and B D by substituting the state 
transition matrix (8.2.2a) into these Eqs. (8.4.6a) and (8.4.6b), which is cumbersome 
in general. As an alternative, it may be better to use a digital computer for evaluating 
them in the following way [F-1 ]: 


4.6a) a T (D.25) -v—i A m T m ^—> A m T m 

= ' = 2“^r = S<^+i)! = + 

D =fV°° ^ll drB = y°° _ <y TB 

Jo ^m= 0 rn\ ^m= 0(m+l)! 


(8.4.7a) 

(8.4.7b) 


with 


* = E 7 


7 ^/+— (/ + —/ + ■■ 




(8.4.8) 

Here, the infinite number of summations in Eq. (8.4.8) is truncated to some finite 
number N, which will be chosen in consideration of the desired accuracy and 
computation time. 


Example 8.3 Discretization of a Continuous-Time State Equation 


Consider a continuous-time LTI system described by Eqs. (E8.1.2) and (E8.1.3) 
in Example 8.1(a), where the state transition matrix is given by Eq. (E8.1.5) as 


C~ x {[sl-A]- 


for t > 0 


(E8.3.1) 
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(a) Find the discretized state equation. 

We can use Eqs. (8.4.6a) and (8.4.6b) to get 


[1 1 

0 


-"IK 


T T + e~ T m | 
■e~ T + l I 1 


~T + e 
1 - 


so that the discretized state equation can be obtained as 


x\[n + 1]1 (8A5) I” 1 1 - e~ T l [xiM] \T +e~ T - 

_x 2 [n+ 1]J _ L° e ~ T JL x 2[«]J + L l ~ e ~ T 


u[n ] 


(E8.3.4) 


%sig08e03.m 

Ns=l; Ds=[1 1 0]; Gs=tf(Ns,Ds); % Analog transfer function 
[A,B,C,D]=tf2ss(Ns,Ds) % Transfer function to state equation 
N=size(A,2); % the dimension of the system 

[Ns,Ds]=ss2tf(A, B, C, D) 

Gsl= C*(s*eye(N)-A)~-l*B + D; pretty(Gsl) % Eq.(8.3.2a) 

% To find the response to step input applied to the 1st input terminal 
[y,x,tt]=step(A,B,C,D,l,t); 

syms s t %for symbolic solution of the state eq. 

A=[0 1;0 -1]; B=[01]'; % Eq.(E8.1.2) 

% Laplace transform solution 

Xs=(s*eye(N)-A)"-1*(xO+B/s) % Eq.(8.2.3a) 

% Inverse Laplace transform 

for n=l:N, xt(n)=ilaplace(Xs(n)), end 

for n=l:length(tt) 

t=tt(n); yl(n)=eval(xt(1)); % Eq.(E8.1.3) with C=[l 0] 

% To solve the differential equation directly 

x=dsolve('Dxl=x2,Dx2=-x2+l r , 7 xl(0)=0,x2(0)=0'); % Eq.(E8.1.2) 

t=tt; y2= eval(x.xl); % Eq. (E8.1.3) with C=[l 0] 

plot (tt,y, 7 k y , tt,yl, 7 b', tt,y2, 7 r 7 ) 

% Discretization 

A= [0 1;0 -1]; B=[0 1] 7 ; C=[l 0]; D=0; % Eq.(E8.1.2) 

[Ad,Bd,Cd,Dd]=c2dm(A,B,C,D,T, 7 zoh 7 ) % Discretized state equation 
[Adl,Bdl]=c2d-Steq(A,B,T) % Eq. (8.4.7a, b) 

% The numerator/denominator of transfer function (8.3.2b) 

[Nz,Dz]=ss2tf(Ad,Bd,Cd,Dd) %Eq.(8.3.2b) to (E8.2.3) or (E8.3.5) 

Nzl= [T-l+e_T l-e_T-T*e_T], Dzl=[l -l-e_T e_T] 

%Gzl= Cd* (z*eye (N)-Ad) ■'-l*Bd + Dd, pretty (Gzl) 

% The z.o.h. equivalent of the analog transfer function_ 
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Note that this is identical to Eq. (E8.1.7) in Example 8.1(b) and the trans¬ 
fer function of the system was computed via Eq. (8.3.2b) as Eq. (E8.2.3) in 
Example 8.2: 


Golzl 


(T- 1 + e~ T )z + 1 - e~ T - Te~ T 
(z - l)(z - e ~ T ) 


(E8.3.5) 


(b) Find the transfer function for the z.o.h. (step-invariant) equivalent of the continuous¬ 
time system. 

Noting from Eq. (E8.2.1) that the transfer function of the continuous-time 
system is 


we can use Eq. (6.2.5) to get 


(E8.3.6) 


(E83.6) Z&$3 ~ | 1 | | PFE Z ~ \ ^ 

1 1 + 1) 11 Z 

B.8(3)£4)&(6) Z ~ 1 / Tz _Z_ Z \ 

z V(z-l) 2 z-1 z-e~ T ) 

_ (T — 1 + e~ T )z + 1 — e~ T — Te~ T 
(z - l)(z - e~ T ) 



(E8.3.7) 


This is the same as the transfer function of the system described by the dis¬ 
cretized state equation (E8.3.4) and output equation (E8.1.8). It is because we 
have assumed that the input is constant during each sampling period in dis¬ 
cretizing the state equation as if a S/H (sampler and zero-order-hold) device 
were installed at the input stage. 

Interested readers are invited to run the above program “sig08e03.m”, check the 
validity of the above results, and see how the MATLAB commands can be used 
to discretize a continuous-time state equation. 
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Remark 8.1 Discretized State Equation and Zero-Order-Hold Equivalent 

The z.o.h. (step-invariant) equivalent of a continuous-time system has the same 
transfer function with the discrete-time system obtained by discretizing the state and 
output equations. 

Example 8.4 Discretization of a Double Integrator 

Consider the continuous-time LTI system described by the state and output 
equations as 



*•>=[> 


For this system, we have 


(E8.4.1) 

(E8.4.2) 


rr_ai-i-IT* °1 _ T 0 1 11 ‘ _ I s - 1 ! ‘ _ I \ s HIV 1 *" 2 ' 
[si A] -|^ Q S J |^o 0 JJ - [ 0 s J _ s 2 l_0 


so that the state transition matrix is 


4>(t) (8 = a) -A]- 1 } b (E 8 = ^ ^ | j for t > 0 (E8.4.4) 

Thus we can use Eqs. (8.4.6a) and (8.4.6b) to get the system and input coefficient 
matrices for the discretized state equation as 

A„ 8 4?‘V(7-)=[J (]and 4tr)d,B = jf [j]it = [^j 

(E8.4.5) 


8.4.2 State Equation with Time Delay 

A continuous-time LTI system with the input u(t) delayed by d [s] can be described by 

x'(t) = Ax(t) + Bu(t - d) (8.4.9) 

There are two cases: (i) 0 < d < T (ii) T < d — MT + d\ with 0 < d\ < T and 
M > 1. 

<Case I> 0 < d < T 

When the time delay d is not longer than the sampling period T, i.e., 

0 < d < T, the second term of the RHS of Eqs. (8.4.4) or (8.4.5) becomes 



8.4 Discretization of Continuous-Time State Equati 


r(n+l)T 

/ <p(nT + T - r)fiu(r - d)dx 

pnT+d 

= / 4>{nT + T — o 

/ nT+T 

<p(nT + T- 

T+d 


<f){nT + T - o)daBu{nT - T) 


<t>(nT + T - a)daBu(nT ) 


where the input signal u(t) is assumed to be constant over each sampling 
interval. Thus Eq. (8.4.5) becomes 


x[« + 1] = A D x[n] + B m u[n - 1] + B DO a[n] 


4>(nT + T — a)dcrB 


(p(T — d + z)drB — cf>(T — d) I (j>{T)drB 


Bdo = J <j>(nT + T - a)d(TB 

nT+ T-a^_ r° 0(T)JrZ?= f T ^ 
JT-d JO 

This can be written in the form of state equation as 

l"x[n + 1]1 _ \A d B d {\ [" x[n] 1 , [Bdo] 


<p(z)dTB (8.4.12c) 


u [n] (8.4.13) 


where K extra state variables u[n — 1] representing the past input values are 
introduced to augment the state vector. 

<Case II> T < d = MT + d\ with 0 < d\ < T and M > 1 
When the time delay d is longer than the sampling period T so that d — 
MT + d\ with 0 < d\ < T and some integer M > 1, Eq. (8.4.11) becomes 


x[n + 1] = A D x[n] + B D 


- M - 1] + B DO u[n - M] (8.4.14) 


where the matrices A D , B D i, and B D o are as defined by Eqs. (8.4.12a,b,c). 
This can be written in the form of state equation as 
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x[« + 1] 


Ad Bdi Bdo O • • • O 

x[n] 

u[n — M] 


0 0 7 0 -0 

u [n - M - 1] 

• 



• 

• 



• 

u[n - 1] 


O O O O 7 

u [n - 2] 

u [n] 


_o o o o -o_ 

u[n — 1] 


"O' 

o 



(8.4.15) 

where (M + l)K extra state variables {u[« — 1], u[« — 2], • • • , u [n — M— 1]} 
representing the past input values are introduced. 



Fig. 8.1 Delayed input signal by d 


Example 8.5 Discretization of a Double Integrator with Time Delay 

Consider the double integrator dealt with in Example 8.4, where the input is 
delayed by d (0 < d < T ). With the state transition matrix <p(t) given by 
Eq. (E8.4.4), we use Eq. (8.4.12) to get the discrete-time system matrices as 

A d = <KT)= (E8.5.1) 

= = (E8 - 5 - 2) 

Bdo = J o <p(T)dTB = ^ 2 r /2 j| = fV-d 72 ] (E8 - 5 ’ 3) 


8.5 Various State Space Description - Similarity Transformation 

As can be seen in Sect. 1.3.4, we could construct many state diagrams for a given 
transfer function and each of them can be represented by a state equation. This 
implies that there is no unique state space model for a certain system. 
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As a matter of fact, we can use similarity transformation to derive any number 
of different state equations, all of which are equivalent in terms of the input-output 
relationship. Consider the state and output equation of an LTI system as 

State equation: 

x'(f) = Ax(t) + Bu(t) (8.5.1a) x[n + 1] = Ax[n] + Bu[n] (8.5.1b) 
Output equation: 

y(t) = Cx(f) + Du(t) (8.5.2a) y[n] = Cx[n] + Du[n] (8.5.2b) 

With a nonsingular transformation matrix P and a new state vector w(t)/w[n], we 
substitute 

x(t) = P w (t) (8.5.3a) | x[n] = P w[n] (8.5.3b) 

into Eqs. (8.5.1) and (8.5.2) to write 

W(t) = P~ l APv/(t) + P~ l Bu(t ) I w [n + 1] = P~ l APw[n] + P~'Bu[n] 

y (t) = CPw(t) + Du(t) | y[n] = CPw[n] + Du[n] 

This can be written as another set of state and output equations: 

w'(f) = Apw(f) + B p u(t) (8.5.4a) I w [n +1] = A p w[n] + B p u[n] (8.5.4b) 

y(t) = C p w(t) + D p u(t ) (8.5.5a) | y[«] = C p v/[n] + D p u[n] (8.5.5b) 

where 

A p = P~ l AP, B p = P~ l B, C p = CP, and D P = D (8.5.6) 
Remark 8.2 Similarity Transformation - Equivalence Transformation 

(1) Note that, with different nonsingular matrices P, we could obtain different set 
of state and output equations as many as we want. 

(2) Transfer function, characteristic equation, and eigenvalues are not changed 
under similarity transformation: 

\sI-A p \ = \sI-P- 1 AP\ = \p- 1 sIP-P- l AP\ = \p- 1 \\sI-A\\P\ = \sI-A\ 

(8.5.7) 

(3) The determinant/trace of A p is the same as that of A, since the determinant/trace 
of a matrix is equal to the product/sum of the eigenvalues. Especially if a system 
has distinct characteristic values, we may derive a state equation with a diagonal 
system matrix having the characteristic values on its diagonal, which is referred 
to as the Jordan canonical or normal form. 
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Suppose we have an N x N system matrix A with N distinct eigenvalues A,- ’s for 
i = 1 : N and the corresponding eigenvectors m, ’s. Then we can write 


or in a more compact form, 


A[mi m 2 • • • m^] = [mi m 2 • • • m#] 


1,2, ■ 

■ ■ ,N 



'A, 0 • 

■ ■ 0 " 


0 a 2 • 

• • 0 

nw] 

_0 0 • 



where M, called a modal matrix, is composed of the eigenvectors as columns, and 
M~ l AM — A is a diagonal matrix with the eigenvalues on its diagonal. The 
modal matrix M is nonsingular if the eigenvalues are distinct and consequently, the 
eigenvectors are linearly independent. This implies that, with the similarity trans¬ 
formation P — M, the resulting system matrix A p will appear to be diagonal in the 
new state equation. 

Example 8.6 Diagonal/Jordan Canonical Form 

Consider a system described by the following discrete-time state and output 
equations: 



(E8.6.1) 

(E8.6.2) 


We can get its eigenvalues and the corresponding eigenvectors as below: 


[J 


|s/- A\ = (s- 

'i = 1 

>1 


l)(s — 2) = 0; si = 1, s 2 = 2 
s 2 = 2 


= 1 


L«2lJ 

;m 2 i =0, mu: arbitrary 


[J 

;m 22 : arbitrary, mn = 3m 22 


Thus we have a modal matrix and its inverse 


M = \” n m i 2 "| _ p 3] M -.Jl -3‘ 

_m 2 1 m 22 J L° l \ ’ L° 1 . 


(E8.6.3) 
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Now, with the similarity transformation P — M, we use Eq. (8.5.6) to obtain another 
set of state and output equations with 


p 3 lp 3 l = p- 3 lp 3 1 = P 0 
L° 2 J L° ! J L ° 2 J L° ! J L° 2 

J : diagonal 


(E8.6.4a) 

.... [i -3iroi r-3i 

L° ij[ij = [ij 

(E8.6.4b) 

-CM = [ ! 0][J 5] = [1 3] 

(E8.6.4c) 


We can use the MATLAB function ‘ jordan () ’ to get a modal matrix and the 
corresponding Jordan canonical form of state equation: 

»A= [ 1 3; 0 2]; [M, Ap] = jordan (A) % [M, L] =eig (A) 

M = -3 3 Ap = 1 0 

0 ... Jjk ,, 0 2 

»B= [ 0; 1]; C=[l 0]; Bp=M\B, Cp=C*M 
B P = i cp = -3 M; 


8.6 Summary 

In this chapter we have studied the state space description of LTI systems in the form 
of the state and output equations. We have also defined the state transition matrix 
and derived the solution of continuous-time/discrete-time LTI state equations. Then 
we have discussed the techniques of discretizing the continuous-time state equations 
and the similarity transformation. 


Problems 

8.1 Controllable/Observable Canonical Form of State Equations 

Complete the controllable/observable form of state diagrams in Fig. P8.1 for 
system having the following transfer function: 


G(s) = 


b 2 s 2 + b\s +ao 
s 3 + a 2 s 2 + ais + a 0 


0*8. U) 


and show that the corresponding state and output equations are 
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8.2 Controllable/Observable Canonical Form of State Equations 
Consider a system having the following transfer function: 


G(s ) 


rfr) 

U(s) 


4(5 + 3) 
2s 2 + 6s + 4 


(P8.2.1) 


(a) Write the controllable/observable form of state and output equations and 
find the state transition matrices. 

(b) Show that the step response is 


y(t) = (3 - Ae~' + e~ 2 ')u s (t) (P8.2.2) 


8.3 State Transition Matrix 

Find the state transition matrix <p(t) = e At for a state equation having the 
following system matrix: 



A = 


(P8.3.1) 
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8.4 State Diagram and State Equation 

(a) Show that the state and output equations for the state diagram of Fig. 1.20(a) 
are 


~x\[n + If 


' 0 1 0 O' 


~xi [n 

x 2 [n + 1] 


-a 0 -a\ b 0 b\ 


x 2 [n 

x 3 [n + 1] 


0 0 0 1 


x 3 [n 

_x 4 [n + 1]_ 


_ 0 0 0 0_ 


_x 4 [n] 




~x\ [n]' 

y[n 

w 

—ao —ai bo b\\ 

x 2 [n] 

x 3 [n] 




_x 4 [n]_ 


(P8.4.1) 


(P8.4.2) 


(b) Use Eq. (8.3.2b) to find the transfer function of the system described by the 
above state equation. 

8.5 Discretization of a Continuous-Time State Equation 

Consider a system described by the following state and output equations: 


x' 2 (t)_ 


'0 1 ' 

1 p.(»l , [01 

0 -2 



y(t)=[ i o] 


'xi (t) 

_xi(t)_ 


(P8.5.1) 

(P8.5.2) 


(a) Use Eq. (8.3.2a) to find the transfer function G(s) of this continuous-time 
system. 

(b) Discretize the above state equation and then use Eq. (8.3.2b) to find the 
transfer function G » \z\ of the discretized system. Compare Gd\z] with the 
z.o.h. equivalent of G(s). 

8.6 Discretization of a Continuous-Time State Equation 
Note that for an oscillator having the transfer function 


we can write the following state and output equations: 



y(f) = [l 



(P8.6.1) 


(P8.6.2) 

(P8.6.3) 


(a) Use Eq. (8.3.2a) to find the transfer function G(s) of this continuous-time 
system. 
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(b) Discretize the above state equation and then use Eq. (8.3.2b) to find the 
transfer function G p \z\ of the discretized system. Compare Gd\z] with the 
z.o.h. equivalent G step [z] of G(s). 

8.7 PWM (Pulse-Width Modulated) Input 

Consider a system described by the following state equation 


_ ro i 

4(0j “ ' 


]K!]+[?]»•' 


where the input u(t) is a PWM signal as depicted in Fig. P8.7. Show that the 
discretized state equation is 


n*i[n + 1]1 ^ [1 1 - e H r*i[n]l \d n 
\_x 2 [n + 1]J L° e ~ T \ L 

u(t) 

A, , ^2 , d 3 d\ 

n n n nn 


e -(T-d n ) + e -Ti 
(T-dn ) _ ~T 


0 T 2T 3T 4T 5T 

Fig. P8.7 A PWM (pulse-width modulated) signal 


8.8 Modal Matrix and Diagonalization of a Circulant Matrix 
Consider the following circulant matrix: 


c(0) 

c( 1)- 

• c(N - 1)" 

c(N — 

1) C(0) • 

• c(N - 2) 

c(l) 

c(2). 

• c(0) 


(a) Show that the eigenvalues and the corresponding eigenvectors of the 
circulant matrix are 

Xi = c{n)W in = c(0) + c(l)W ! + • • • + c(N - l)W (iY_1) '', 

W = e i2jl/N (P8.8.2) 

m, = [1, W\ • • • , W (Ar “ 1)i ] r , i = 0 S 1, • • • , N - 1 (P8.8.3) 


so that 


Cm, = A,m, 


(P8.8.4) 
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(b) Note that a modal matrix consisting of the eigenvectors can be written as 


1 1 
1 W 1 


Show that the inverse of the modal matrix is 


1 1 
1 W~ l 


— M* (Conjugate transpose) (P8.8.6) 


(c) With the matrix dimension N = 4, diagonalize the circulant matrix C by the 
similarity transformation. For reference, you can run the following 
program “sig08p_08.m”. 


%sig08p_08 .if; 
clear, elf 
syms cO g|-: 'fa-2- c3 

C=[cO cl c2 c3; c3 cO cl c2; c2 c3 cO cl; cl c2 c3 cO]; 
[M, L]=jordan(C) % [M, L]=eig(C) 

M*M' 
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Appendix A 

The Laplace Transform 


The Laplace transform was discovered originally by Leonhard Euler (1707-1783), 
the great 18th-century Swiss mathematician and physicist, but is named in honor of 
a French mathematician and astronomer Pierre-Simon Laplace (1749-1827), who 
used the transform in his work on probability theory. He was such a genius not 
only in mathematics that the great mathematician Simeon Poisson (1781-1840) 
labeled him the Isaac Newton of France, but also in politics that he could serve three 
regimes in revolutionary France - the republic, the empire of Napoleon, and the 
Bourbon restoration, having been bestowed a count from Napoleon and a marquis 
from Louis XVIII. 

The Laplace transform is a very useful tool in solving differential equations and 
much further, it plays an important role in dealing with linear time-invariant systems. 


A.l Definition of the Laplace Transform 

The (unilateral or one-sided) Laplace transform is defined for a function x(t ) of a 
real variable t (often meaning the time) as 

X{s) = C{x(J)} = f x{t)e~ s, dt (A.l) 

no¬ 
where s is a complex variable, the lower limit, t_, of the integration interval is the 
instant just before t = 0, and x(t) is often assumed to be causal in the sense that it 
is zero for all t < 0. 

A.2 Examples of the Laplace Transform 
A.2.1 Laplace Transform of the Unit Step Function 

The unit step function is defined as 
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6 (t) =«mr T (f)= j!" f(u s (f + |)-u 8 (f-|)) =| 14(f) 



0 0 0 
(a) Unit step function (b) Rectangular pulse (c) Unit impulse function 

Fig. A.l Unit step, rectangular pulse, and unit impulse functions 


(l 

1 ° 


for t > 0 
for t < 0 


(A.2) 


which is depicted in Fig. A. 1(a). We can use Eq. (A.l) to obtain the Laplace 
transform of the unit step function as 


£(«.«»'“=" r»,Me-»* w = 2> fWH 3> A = , )= : 

Jo Jo -s 0 -s i 


This Laplace transform pair is denoted by 


Us(f) 


1 


(A.3) 


A.2.2 Laplace Transform of the Unit Impulse Function 

The unit impulse function can be defined to be the limit of a rectangular pulse func¬ 
tion r T (t) with the pulsewidth T 0 (converging to zero) or simply, the time 
derivative of the unit step function as 

m = ItaMS = am i (», (> + |)- ». (> - I)) = |»V» (A.4) 

which is depicted in Fig. A. 1(c). We can use Eq. (A.l) to obtain the Laplace 
transform of the unit impulse function as 


Wit)} 


-!? 


This Laplace transform pair is denoted by 


(A.5) 
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A.2.3 Laplace Transform of the Ramp Function 

The Laplace transform of the unit ramp function tu s (t ) is obtained as 

CUum^'f tu s (t)e~ s, dt ( = 2) J te~ sl dt <D = 6) e _sr |~ + j J e~ s, dt <D = 3) ^ 

This Laplace transform pair is denoted by 

tu,(t) 4 (A.6) 

s z 

A.2.4 Laplace Transform of the Exponential Function 

The Laplace transform of the exponential function e~ a, u s (t) is obtained as 

£{e _a, Wj(0} < = 1) J e^ M u s (t)e~ st dt ( == J J e~ al e~ s, dt = jf e~ (s+a), dt (D = 3) + 

This Laplace transform pair is denoted by 

e~ a, u s (t ) ^ (A.7) 


A.2.5 Laplace Transform of the Complex Exponential Function 

Substituting a + j to for a into (A.7) yields the Laplace transform of the complex 
exponential function as 


■ (<T+ ' / '“ ), K J (0 (D = 0) e“' T, (cos(Wt - j sin a>t)u s {t) 

1 _ s + a _ co 

s + 0 + joo (s + or) 2 + <w 2 J (s + a) 2 + (O 2 


(s + a) 2 + ai 


e sin u s (t) <- 


(A.8) 

(A.9) 


A.3 Properties of the Laplace Transform 

Let the Laplace transforms of two functions x(t ) and y(t) be X(s) and Y (.s’), 
respectively. 
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A.3.1 Linearity 

The Laplace transform of a linear combination of x(t) and y(t) can be written as 

a x(t) + py{t) aX(s) + pY(s) (A.10) 

A.3.2 Time Differentiation 

The Laplace transform of the derivative of x(t) w.r.t. t can be written as 

x'(t) ^ s X(s) - x(0) (A.11) 

Proof 

C{x\t )} 0 = !> J ^e £/t (D = 6 > x(t)e _i, |~-(-i) J x(t)e "dt ( = ’.v X (.v)-x(O) 

Repetitive application of this time differentiation property yields the Laplace trans¬ 
form of n th-order derivative of x(t) w.r.t. t as 

x (n \t) ^ s n X(s ) - ^“^(O) - s n ~ 2 x\ 0)-x (,,-1) (0) (A. 12) 

A.3.3 Time Integration 

The Laplace transform of the integral of x(t) w.r.t. t can be written as 

J' x(T)dT ^ ^X(s) + ~ J° X(T)dz (A. 13) 

This can be derived by substituting f x(z)dr and x(t) for x(t) and x’(t) into 
Eq. (A.ll) as 

x(t) X(i) = sC |y x(t )dz }-/: x(r)dr 

Repetitive application of this time integration property yields the Laplace trans¬ 
form of n th-order integral of x(t) w.r.t. t as 

J J ■■ j x{z)dz n -^s~ n X{s) + s~" j x(z)dz + --- + J J ■ j x(z)dz" 

(A. 14) 
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A.3.4 Time Shifting - Real Translation 

The Laplace transform of a delayed function x(t) can be obtained as follows. 

C {x{t - h)} ( = n f x(t - h)e~ s, dz + f x(t - h)e~ s, dr 


x{t - h), h > 0 


— % e st> J x(z)e ST dz + e sh J 

(iw +f 


x(z)e sr dz | 


x(z)e ST dz; 

~ st ‘X(s) 

(A. 15) 



Fig. A.2 Switching the order of two integrations for double integral 


A.3.5 Frequency Shifting - Complex Translation 


e Si, x(t) 


X(s-s i) 


(A. 16) 


A.3.6 Real Convolution 

The (real) convolution of two (causal) functions g(t ) and x(t) is defined as 

g(t) * x(t) = J gtz)x(t - z)dz' Sg(t) °3;;; ov,<o y g^xtt - z)dz 

(A. 17) 

The Laplace transform of the convolution y(t) = g(t) * x(t) turns out to be the 
product of the Laplace transforms of the two functions as 


y{t) = g(f) * x(t) ^ Y(s ) = G^)A(s) 


(A. 18) 
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Proof 

C{g(t)*xm ( ^ ) J g(f> * x(t)e~ st dt (A = ?> J |/ g(x)x(t - x)dr^e~ st dt 
Fl == 2 J g(r)e~ ST x(t - r)e~ s(t ~ T) dt dz 
(t = V) f Q 8 ^ eSX [J x{v)e~ sv dv^dx 

( = l> [ g(T)e~ sr dTX(s ) ( = !> G (s) X (s) 

Jo 

This property is used to describe the input-output relationship of a linear time- 
invariant (LTI) system which has the input x(t), the impulse function g(t), and 
the output y(t), where the Laplace transform of the impulse function, i.e., G(s) = 
£{g(t)}, is referred to as the system function or transfer function of the system. 


A.3.7 Partial Differentiation 

Given the Laplace transform of a function having a parameter a, that is £{x(t, a)} = 
X(s, a), the Laplace transform of the derivative of the parameterized function x(t, a) 
w.r.t. a equals the derivative of its Laplace transform X(s,a) w.r.t. a. 

—x(t, a) —X(s, a) (A.19) 


A.3.8 Complex Differentiation 

The Laplace transform of —tx(t) equals the derivative of C{x(t)) = X(s) w.r.t. s. 

tx(t)^-^-X(s) (A.20) 

ds 

This can be derived by differentiating Eq. (A.l) w.r.t. s. 

Example A.l Applying Partial/Complex Differentiation Property 

To find the Laplace transform of te~ a 'u s (t), we differentiate Eq. (A.7) w.r.t. a 
and multiply the result by — 1 to get 



(s + a) 2 


(A.21) 
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Multiplying t by the left-hand side (LHS) and applying the complex differentia¬ 
tion property (A.20) repetitively, we get 


0 + a) 3 


(s + a ) m+1 


A.3.9 Initial Value Theorem 

We can get the initial value of x(t) from its Laplace transform C{x(t)) = X(s) 
follows. 


jt(0)= hm sX(s) 


(A.24) 


This can be derived by substituting s = oo into the time differentiation property 
(A. 11) as 

lim s A(s) — x(0) (A = !) lim C {x'(f)} lim J x'(t)e~ s ‘dt = 0 


A.3.10 Final Value Theorem 

We can get the final value of x(t) from its Laplace transform C{x{t)} — X(s) 
follows. 


x(oo) = lim s A(s) 

s->0 


(A.25) 


on the premise that x(t) is convergent, or equivalently, all poles of X (,v) are in the 
left-half plane (LHP) except for a simple pole at s = 0. This can be derived by 
substituting s = 0 into the time differentiation property (A.l 1) as 

hm s X(s) — x(0) (A = 1} lim £ {x'C?)] lim [ x'(t)e~ s, dt =x(oo) — x(0) 

(Q) Can we apply this final value theorem to have sin ojt\ t=00 — lim ,v 

X(s) Table = 1(7) limi^^2 = 0? 
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A.4 Inverse Laplace Transform 


Suppose a s-function X(s ) is given in the form of a rational function, i.e., a ratio of 
an M th-degree polynomial Q(s) to an N th-degree polynomial P(s) in s and it is 
expanded into the partial fractions as 


Q{s ) _ bMS M + ... + b\s + bo 
P(s ) a N s N + ... + a\s + a 0 


■(§a)- 


r N-L +1 r N 

s - p (s - p) L 


P{s) 
\ (s - p)‘ 


S = Pn 


Then the inverse Laplace transform of X(s) can be obtained a 


(A.26) 


(A.27) 


(A.28.1) 

(A.28.2) 


x(t) 



■ tx-m# 1 * + r N-L+zt e pl + . 


r N l-i p , 
(L-l)! ^ 


uAO+KM) 

(A.29) 


Example A. 2 Inverse Laplace Transform 

Let us find the inverse Laplace transform of the following s-functions 


(a) 


3s 2 + lli + 11 _ 3s 2 + 11s + 11 
s 3 + 4s 2 + 5s + 2 ~ (s + 1 ) 2 (s + 2) 

= —^—-1- — -1-——- (with a double pole at s = — 1) 

s + 2 s + 1 (i + l) 2 


( 1 ) 


We can use the formula (A.28.1) to find the simple-pole coefficient r\ as 


/-!= (* + 2)X (i) | 5= — 2 =(5 + 2) 


3s 2 + 11s + 11 
(s + l) 2 (s + 2) 


( 2 ) 


and can also use the formula (A.28.2) to find the multiple-pole coefficient r2 and 
7*3 as 
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d 7 I d 3s 2 + 11s + 11 I 

r 2 = -j-is + 1 fX(s) L_! = --^ 

ds | as s+2 \ s 

(D31) (6s + 1 l)(s + 2) - (3s 2 + 1 Is + 11) I 


= 2 


(4) 


is + 2) 2 

Thus the inverse Laplace transform can be written as 

x{t) = (rie -2 ' + + r 3 te~ ( )u s (t) = {e~ 2t + 2e~‘ + 3 te~ ( )u s (t) (5) 

(A.29) 

»Ns= [3 11 11]; Ds=u 4-.|g]; [r, p,k]=residue(Ns,Ds), [A, B] =residue (ryjs/k) 


(b) X(s) = S 

s 2 + 2s + 2 

s (b) 

=---- (with complex conjugate poles at s = — 1 ± j) 

(s + l) 2 + I 

We may use the formula (A.28.1) to find the coefficients of the partial fraction 
expansion form 


X(s) = 


s 2 + 2s + 2 


n + r2 

s+ 1-7 s+ 1+7 


(7) 


n (A '=' 1) (i + l - j)X (s) l^-i+j = s . = o.5(i + j ) 

s |^ +j (8) 

r 2 <A =' 1} (s + i + j)x (s) \ s =-i-j = —4 -t = 0.5(1 - j) 

s + 1 _ J I j=—1—7 

Thus we can write the inverse Laplace transform as 

x(t ) = (0.5(1+ 7 ')e (_1+7)f + 0.5(1 — <F = 0) e _? (cost — sin t)u s (t) 

(9) 

In the case of complex conjugate poles, it may be simpler to equate X(s) with 
the following form 


= S = A(s + 1) 8X1 common denominator As + (A + B) 

' ' ,v 2 + 2s + 2 (s + 1) 2 + l 2 + (s + 1) 2 + l 2 (s + l) 2 + l 2 

( 10 ) 

and get the coefficients as A — 1 and B = — 1. Then we can directly find each 
term of the inverse Laplace transform from the Laplace transform Table A.l and 
write the inverse Laplace transform as 




394 


Appendix A 


Table A.l Laplace transforms of basic functions 


x(t) X(s) 

x(i) 


X(s) 

x(t) 

X(s) 

(i) m i 

(5) e" 0 

'«,(;) 

s + a 

(9) e~ at sin 

cot «,(/) (j + fl)2 + ^ 

(2) S(f - h) e - f ' s 

(6) ft 

•~ a, u s (t) 


(10) e~ al cc 

rcotu(t) S+ ° 

(,s + a) m+1 

scot M s (f) (s+a)2+Q)2 





(4 )ruM ^ 

(8) cos 

cot u s (t) 








(—1) X 1 Table 
(S + l ) 2 + l 2 


A.l(9),(10) 


x(t)={e~ 


sin t)u s (t) 


(U) 

(c) Use of MATLAB for Partial Fraction Expansion and Inverse Laplace Transform 
We can use the MATLAB command “residue ()” to get the partial fraction expan¬ 
sion and “ilaplace ()” to obtain the whole inverse Laplace transform. It should, 
however, be noted that “ilaplace ()” might not work properly for high-degree 
rational functions. 


r = 1.0000 


3.0000 


■ftSflll 4 5 2]; 
p = -2.0(g||l 



[r p],k % (1) 


»syms s, x= ilaplace ( (3*s~2+1.1*s+11) / (s''3+4*s'2+5*s+2) ) 
x = exp(-2*t)+3*t*exp(-t)+2*exp(—t > % (5) 

»Ns=[l 0]r'O#=[l 2 2]; [r, p, k] =resiaue (H'jAiSiL [r p],k % (6) 

r = 0.5000 + 0.50001 p = -1.0000 + 1.00001 % (8) (0.5+0.51)/(s+l-i) 

0.5000 - 0.50001 p = -1.0000 - 1.00001 % (8) (0.5-0.51)/ (s+l+i) 

k = [] 

»syms s, x ilaplace (s/ (s , '2+2*s+2)) '"ll:'; 


x = exp (—t) *cos (t) -exp <-t) *sin (t) % (9) or (11) 

>>ilaplace (s/(s~4+-10*s“3+9*s"2 + 6*s+l)) %?? Ks 0].; Bfi=[l 1.0 9 6 1]; 


A.5 Using the Laplace Transform to Solve Differential Equations 

One can realize how useful the Laplace transform is for dealing with linear ordinary 
differential equations. 

Example A. 3 Solving a Differential Equation 
Let us solve the following differential equation. 

^y(t) + 3 j t y(t) + 2 y(t) = 10n,(f), t > 0 (1) 

with the initial conditions y(0) = 1 and /(0) = —2. 
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(Solution) 

We make use of the time differentiation properties (A. 11) and (A. 12) of Laplace 
transform to write the Laplace transform of both sides as 

, , 10 
s 2 F(s) - jy(0) - y'(0) + 3(sF(s) - y(0)) + 2F(s) = —; 


This algebraic equation can be solved for Y (s) as 

*(. + !) +10 

s(s 2 + 3s + 2) 

We expand this s -domain solution into partial fractions as 

_ s(s+ 1) + 10 _n r 2 r 3 _ 5 -10 6 

s(s 2 + 3s + 2) s s + 1 s + 2 s s + 1 s + 2 

where the coefficients are found by using the formula (A.28.1) as 

w ,, 0) s 2 + i + 101 

r i — sY (.v) | v o — , ,—-t =5 

s l + 3s + 2 \ s=0 

(3) -L c -L 1 0 I 

r 2 = ( i + l)F( S )| s= _ i y 


s(s + 2) | i= _! 


= 6 


s(s + 1) 

Thus we can write the time-domain solution y(t ) as 

y(t) = (ne~ 0t + r 2 e~' + r 3 e~ 2, )u s (t ) = (5 - 10e _t + be 2, )u x (t) 


»syms s, Ns= [ 1 1 10]; Ds=[l 3 2 0]; 

>ay-ilapl*oe.<poly2sym(Ns, s) /poly2sym(Ds, s)) % Inverse Laplace transform 
»yl=ilapfaWe< (s*2+s+10)/(s"3+3*s"'2+2*s) ) % Or, directly from Eq. (3) 
»t#=B i 0.01:10; yt=eval (y) ; plot(t,yt), hold on % plot y(t) for t=[0,10] 
>> [r,p, k] =residtie (Ns, Ds) , % Partial ■expansipjas-, 

»ytl=real (r.' *exp (p*t) ) ; plot (;., ytl, ' r' ) % Another way to syets y (t) 

Another alternative way to solve differential equations using MATLAB is to 
use the symbolic differential solver “dsolve () To solve Eq. (1), we need the 
following MATLAB statement: 


•>y=dsolve('D2y+3*Dy+2*y=0' ,'y(0)=1, Dy(0)=-2' 
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Table A.2 Properties of Laplace transform 

X(s) = *{*(*)} = /o°° x(t)e~ st dr, x(t) 4 X(s) 
a x(t) + Py(t)^aX(s) + py(s) 


(0) Definition 

(1) Linearity 

(2) Time shifting (Real translation) 


(3) Frequency shifting (Complex translation) 

(4) Real convolution 

(5) Time derivative (Differentiation property) 

(6) Time integral (Integration property) 

(7) Complex derivative 

(8) Complex convolution 

(9) Initial value theorem 

(10) Final value theorem 


x(t - h)u s (t - h), h> 0 -o- 

e~ m {x(s) + /° fi x(T)e-”dr} = e~ s, 'X(s) 

for x(t) = 0 Vt < 0 

e s ''x(t) -b. X{s - Sl ) 

g(t)*x(t)*+G(s)X(s) 

x'(4 = 4* sX(s) - x(0) 

I-ooXMdr -B- iX(j)+ 

tx(t)4*-±XU) 

X(t)y(t) X(v)Y(s - v)dv 

x(0) = lhn s X(s) 
x(oo) = limi X(i) 


Theorem A.l Stability Condition of an LTI system on its Pole Location 
A linear time-invariant (LTI) system having the system or transfer function G(s)/G[z] 
is stable iff (if and only if) all the poles ofG(s)/G[z ] are strictly within the left-half 
s-plane/the unit circle in the z-plane (see Remarks 2.5, 3.2, and 4.5). 

Proof Noting that the system or transfer function of a continuous-time/discrete-time 
system is the Laplace/ z-transform of its impulse response g(t)/g\ri], let the system 
function of a causal LTI (linear time-invariant) system be 

G(s) = C{g(t)} = f g(t)e~ s ‘dt I G[z] = Z{g[n]} = J2°° =0 g[> l ]z~ n 

(la) | "" ( lb ) 

Taking the absolute value yields 

|GCs)l=| J o g(t)e~ s, dt\ 

< I" \g(t)\\e~ s, \dt (2a) 

Jo 

Suppose that 

G(s) has a pole at ,v = s p = rr p + jco p I G[z] has a pole at z = Z p = r p e jn i’ 
with o p > 0 on the RHP (right-half with r p > 1 outside the unit circle in the 
s-plane) | z-plane 


(2b) 
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so that 

|G(^)| = oo (3a) | \G[z p ]\ = oo (3b) 

We can substitute this pole into Eq. (2a)/(2b) to get 

oo —* |G(s p )| ( < j oo = 5 \G[z p ]\ ( <* l r p"I \e ~* Qpn |; 

oo <J \g(t)\dt (4a) 00 - X!„ = o lg[ ” ]| (4b) 


which contradicts the stability condition (1.2.27a)/(1.2.27b). This imphes that if 
even a single pole of a system exists in the unstable region, i.e., on the RHP in the 
s -plane or outside the unit circle in the z-plane, then the system is unstable. This 
completes the proof of the theorem. 

The stability condition can be understood more clearly if we expand the system 
function into the partial fractions and take its inverse transform to write the impuse 
response as 


g(t) = eL 


A k 

s-s k ' 

a k e Stt 


(5a) 


°w = E»o— • 

^*=0 Z~Zk 

s [n] = EL A * z * 


(5b) 


This shows that even a single pole with Re{s*} > 0 or | z k I > 1 causes the impulse 
response to diverge, which violates the BIBO stability condition (1.2.27). 
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Tables of Various Transforms 


Table B.l Definition and properties of the CTFS (continuous-time Fourier series) 


(0) Definition 

Synthesis: xp(t) (2 '= a) i ^ X k e itw °', P: period of xp(t) 


Analysis: X k (2 = b) f p x P 0)e-J kw ’ , (ll, m 0 = ^ 

(1) Linearty 

ax P (t) + bMt)£aX k + bY k 

(2) Time reversal 

x P (-t)&X^ k 

(3) Symmetry for real-valued 

Real-valued x P (t ) = x P , e (t) + x P , 0 (t) +>X k = X*_ k 

functions 

Real-valued and even x P , e (t) & X k , e = Re{X*} 

Real-valued and odd x P , 0 (,t)**X ki0 ri ylmfXj.) 

(4) Conjugate 

^(0^, 

(5) Time shifting (Real translation) 

xr(t - h) +* X t e-f**#k = \X k \Z.(<t> k - ktooh) 

(6) Frequency shifting (Complex 

xp(t)e iMan ' C 5 S X k - M 

(7) Real convolution 

xp(t)*ypV ) ~Jp x(x)y(l - x)dx C S S X k Y k 

(periodic/circular) 


(8) Complex convolution 

xp(t)Mt) C <* j. E™=-00 X m Y k _ m 

(9) Time differentiation 

jkoioX/c 

(10) Time integration 

r‘ , u / finite-valued and periodic \ ctfs t 

J-oo x (x)dxy only if x 0 = 0 ) pT* 

(11) Scaling 

x(at), a> 0 ctfs X k 

(periodic with period P/a) (with fundamental frequency acoo) 

(12) Parseval’s relation 

JZ o \xp(t)\ 2 dt = i E£-oc 
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Table B.2 Definition and properties of the CTFT (connnuous-time Fourier transform) 

(0) Definition 

X(j(o) = f{x(t)} <2 '= a) /!^ x(t)e-j°”dt 

(1) Linearity 

ax(t) + by(t) 4 aX(fd) + bY(co) 

(2) Time reversal 

x( ~t} 

(3) Symmetry for real-valued functions 

Real-valued x(t) = x e (t) + x„(t) 4 X{a>) = X*(-co) 


Real-valued and even x c (t) X e (co) = Re{X(cu)} 


Real-valued and odd x„(t) X 0 (a>) = j ImjX)®)} 

(4) Conjugate 

x*(t)&X*(-a>) 

(5) Time shifting (Real translation) 

x(t - h) -5- X((o)e- Ja ”' = X(co)Z - hoo 

(6) Frequency shifting (Complex 

x(t)e Ja, ' t J+ X(a>-a i) 

(7) Duality 

g(t) £ /(«) fit) -5- 2ng(-co) 

(8) Real convolution 

y(t) = x(t) * g(f) Y(f0) = X(fi>)G(o>) 

(9) Complex convolution 

y(t) = x(t)m(t) Y((o) = ± X(co) * M((o) 

(10) Time differentiation 

** icoX(a>) 

dt (2.5.17 ) J 

(11) Time integration 

f-oox(T)dx £ 7iX(OMeo) + J, X(co) 

(12) Scaling 

x(at \2tn) (?) 

(13) Time multiplication-Frequency 
differentiation 


(14) Parseval’s relation 

JZo \ x (t)\ 2 dt = 2^ Ho l^(<w)| 2 rf® 




Table B.3 CTFS/CTFT for basic functions 


function x(t) 

CTFS X k (for periodic function) 

CTFT X(co) (for periodic/aperiodic function) 

E X k e^',(Oo= 2 J 

x k 

( ^» 3) y £ X k S(co-kcoo ) 

(2) e Ja °', co 0 

X _ | p for fe = 1 

A — [ 0 elsewhere 

2jzS(co — coo) 

(3) coscoot, co 0 = 2 J 

_ | P/2 for k = ±1, • • • 
k ~ { 0 elsewhere 

(EZU.2) ^ 

(4) sincuof, coo - 

f -/P/2 for fc = 1 
X k =\jP/2 forfc = — 1 

1 0 elsewhere 

—> jn(&(co + coo) — S(co — <wo)) 

(5) Constant function x(t) = 1 

x _\P for k = 0 
k | 0 elsewhere 

<E ”' 1) 2; tS(co) 

(6) Impulse train S(t — iP) 

X k = Wk 

-jr I] i(® - too)- 

(7) Rectangular wave £ r D (t — i P), D < P 

X k = D sine (^P), co 0 = fr 

^ £ X k $(co-kco 0 ) 

(8) Rectangular pulse r D (t) = u s (t + §) — u s (t — 

N/A for an aperiodic function 

D sinc(^r&>) <E =' 2) 

(10) 5(f) 

N/A for an aperiodic function 

N/A for an aperiodic function 

(E2.9.1) 1 1 for |co| < P 
| 0 elsewhere 

(ID uM 

N/A for an aperiodic function 

<E ^' 6) + nS(co) 

(12) e- a, n s (f), Re{a} > 0 

N/A for an aperiodic function 


(13) te~ a, u s (t), Re{a} > 0 

N/A for an aperiodic function 


(l 4 )(£Jj- f e^(f),Re{a}>0 

N/A for an aperiodic function 
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Table B.4 Definition and properties of the DTFT (discrete-time Fourier transform) 


(0) Definition 

DTFT: X(Q) = X[e> a ] = T{x\n \} ( =‘ ) ZZ-oo x[n]e~J a " 
IDTFT: x[n] = jF _1 {X(£2)} (3 = 3) £ f 2j[ X{Q)e) an dQ. 

(1) Periodicity 

X(£2) = X[e ja ] = X(Q + 2mn) for any integer m 

(2) Linearity 

ax[n] + by[n] 4 aX(Q) + bY(Q.) 

(3) Time reversal 

x[-n] 4 X(-S2) 

(4) Symmetry for real-valued 

Real-valued x[n] = x e [n] + x„[n] 4 X(Q) = X*(-Q) 

sequences 

Real-valued and even x e [n\ ^4 ^ X,,(Q) = Re{X(£2)} 
Real-valued and odd x„[n\ -£ XJQ) = j Im{X(f2)} 

(5) Conjugate 

x*[n] 4x*(-0) 

(6) Time shifting (Real 
translation) 

x[n - ni] 4 X(S2)e ian = X(£2)Z - m£l 

(7) Frequency shifting (Complex 
translation) 

x[ri\e ja ' n 4 X(Q - S2i) 

(8) Real convolution 

*[»]**[»] 4 X(n)G(Q) 

(9) Complex convolution 
(circular) 

x[n]m[n] 4 -Lx(«) * M(Q) 

(10) Differencing in time 

x[n]-x[n- l]4(l-«-4n)X(0) 

(11) Summation in time 

T, x[m] = x[ri\*u s [n] 4 


I .T.V(O) f; 5(£2-2jri) 

(12) Scaling 

= j 0 n,K1 „£l X(ICa) 

(13) Time multiplication- 

Frequency differentiation 

(14) Parseval’s relation 

fw[i»]4 

ZZ-oc \x[n ]| 2 = J§ / 2jr |X(£2)| 2 dQ 



Table B.5 Definition and properties of the DFT/DFS (discrete-time Fourier series) 


(1) Periodicity 

(2) Linearity 

(3) Time reversal 

(4) Symmetry for real-valued sequences 


(5) Conjugate 

(6) Duality 

(7) Time shifting (circular) 

(8) Frequency shifting (circular) (Complex translation) 

(9) Real convolution 

(10) Complex (circular) convolution 


(11) Scaling 

(12) Parseval’s relation 


X(k) = DFTjy{x[n]} = x\n]e~ i2l ' kn l N = x[n] W k N n 

x[n\ = IDFT JV {X(fc)} (3 = 3) X J2k=o X(k)e> 2ltkn l N = A ^f = “ 0 ‘ X(k)W^ kn 
X(k) = X(k + mN) for any integer m 
ax[n\ + by[n] "2? aX(k) + bY(k) 

x[—ri\ru[ri\ +> Xp/(—k)rpt[k] (rjv[&] = u s \k] — u s \k — IV]) where xn\n] is the periodic 
repetition of x[n] with period N 
Real-valued x[n] = x e [n] + x 0 [n]^ X(k) = X* N (-k)r N [k] 

Real-valued and even x e [n] X e (k) = Re{X(fc)} 

Real-valued and odd x„[n] X a (k) = j Im{A r (fe)} 
x*[nf™ X* N (~k)r N [k] 
gin] ^ f(k) O fin] ^ 

xu[n — M]r N [n]{oae period of circular shift) Wff k X(k) 

Wn~ l " x[n] X N (k — L)r^[fe](one period of circular shift) 

(SS) 1 xtOKn ~ i')) r N [n} D S X(k)Y(k) 
x[n]y[n] D ^ i (l2; v 0 ' X N (i)Y N (k - i)) r N [k\ 

'«> w = j f /K] 

J2n= < N> |xf[«]| 2 = ^ J2k=<N> \X(k)\ 2 where < N >= {0, 1, • • • , N - 1) 
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Table B.6 DFS/DFT and DTFT for basic sequences 


Sequence x[ri\ 

DFS X(fc)/DFT X(k) (for periodic/aperiodic and 
finite-duration sequences) 

DTFT X(S2) 

(i) j,- £ X k e iMn/p ,P = NT 

X(k) = \ 

l fX k 

2 f X k 8(Si-k§ 1 

(2) e JKS2on , n 0 =%- 

Xik) = j 

' N for k = K, K ± N, K ± 2N, ■ • • 

0 elsewhere 

<3 i 5) 27r £ 5(S2 - KSl 0 - 2nk) 

(3) cos K£ion, £2o = — 

X(k) = | 

: N/2 for k = ±K, ±K ± N, ■ ■ ■ 

0 elsewhere 

(E3J.2) “°° «(£2 + KQ 0 - 2itk) 

71 khoo - K£l 0 - 2nk) 

(4) sin K£l 0 n, Q 0 = ^~ 

X(k) = | 

[ -jN/2 for k = K, K ± N, ■ ■ • 
jN/2 for k = -K, - K±N , • • • 

1 0 elsewhere 

(E3.7.1) . ~ 3(S2 + K£2 0 ~ 2 7ik) 

Jn k *-: x - KCi 0 - 2nk) 

(5) Constant sequence x[ri\ = 1 

X(k) = | 

N for k = 0, ±N, ±2N, ■ ■ ■ 

0 elsewhere 

(E3 4 l) 2n J2 8(^1 — 2nk) 

(6) £ S[n-iN] 

W) = l 

Vfc 

2 f E 8(S2 - kOo), n 0 = gt 

(7) Rectangular wave 

£ r 2M+i [n-iMl 2M + 1 < N 

X(k) = 5 

iin(fcf2 0 (2M + l)/2) n 2n 

£ E X(k)S(Q - kUo) 

sin(*£2 0 /2) ’ N 

(8) Rectangular pulse 
r 2M+l\n] 

= u s [n + M\-u s [n-M- 1] 

sin(fcS2 0 (2M + l)/2) ^ 2n 

X(.k) = -. ...-with £2 0 = — 

sin(fcS2o/2) N 

(E3.1.2) sin(£2(2M + l)/2) 
sin(£2/2) 
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Table B.6 (continued) 


Sequence x[ri\ 

DFS X(k)fD¥T X(k) (for periodic/aperiodic and 
finite-duration sequences) 

DTFT X(£2) 

(g , sin(Bn) _ B sjnc ^ j 

N/A for t 

in infinite-duration aperiodic sequence 

(E^.l) | 

1 for |£2 — 2m7r| < B <n 

0 elsewhere 

(10)«[»] 

X(k) = 1 

V0<fc<iV-l 

(E3A1) ^ 


tin i i 

N/A for a 

in infinite duration a eriodic se uence 

(E3.8.6) 

__l_ 5(f2_27 t/) 

( )u s \n\ 

in in m e- ura on apeno tc sequence 



(12) a n u s [n] with |a| < 1 

N/A for e 

in infinite-duration aperiodic sequence 

(E3.2.1) 

i 00 

1 

1 - ae~J a 

(13) (n + l)a" u s [n], \a\ < 1 

N/A for e 

in infinite-duration aperiodic sequence 

d-a- 


(14) a 1 " 1 with |a| < 1 

N/A for a 

in infinite-duration aperiodic sequence 

(E3.3.1) 

1 - a 2 


i — 2 a cos £2 + a 2 
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Table B.7 Definitions and properties of the Laplace transform and z-transform 


Laplace transform 

_ 1 _ 

z -transform 

X(s) = £{*(()} = \~_x(t)e~ s, dt 

Bilateral(t\vo-sided) 

X|zJ = Z(jr[n)} = Z”— xln]z~” 

X(s) = £{x(t)} = I” x(t)e-“dt 

Unilatcral(onc-sidcd) 

xiz] = £{*!»]} -2£,*Mz- 


(1) Linearity ____ 

aX(s) + bY(s\ | ax(t)+by(,) \ ax[n)+ &y[n] | aXlz] + bY[ 2 \ 

(2) Time shifting (Real translation) 


e"’X(s) 

e { X (z)+J_° (i x(r)«-"rfr} 
e J "'{A'(s)-J„x(r)e' T dr} 

x(r-/,) 

Jf(f-ft), h>0 

x(/+/,), /,>0 

*[»-»>! 

xjn+njl.ni >0 

z-’'X[z] 

z'* 1 { flz] + £»-»■*[«]*"" } 

(3) Frcqucncv shifting (Com 

alex translation) 

Jf(s-si) 

[ e«'x(0 | zf x[n\ | X[z!z\] 


(5) Time derivative (Differentiation properly) 1 Differencing 


<Bilateral> sX(s) 
<Unilateral> sX{s) - x(0) 


r[n]-r[n-l] 


<Bilateral> (l-z"')X[z] 
<Unilateral> (l-r _l )-V[z|-x|-l| 


(6) Time integral (Integration property) 


<Bilateral> - X(.v) 

<Unilateral> —(.Jf(s)+J|_x(z)dr) 


JL X(T)dT 


<Bilateral> -—-X|z| 

<Unilateral> ^ * _ x (A~[z| + Z x[ml) 


(7) Complex derivative 


(8) Complex convolution 

2~y iZ~ X( y> Y 

(9) Time scaling _ 

a X(as) 

(10) Time reversal _ 

X(--v) _ 

(11) Initial value theorem 
x(0) = lim sX (i) 

(12) Final value theorem 
*(<*>) = lim \X(s) 


x(/)y(0 


x(l/a) 


x(-0 


A n \y\ n \ 


xln/M] 

(A/ : a positive integer) 


4-n] 


x[0] = lim.V[z] 


^-j§ c X[zl V ]Y[ V }dv 


Xlz M ] 




*M = Um(l-z-')X[zl 




Table B.8 Laplace transforms and z-transforms of basic functions/sequences 


X(s) = C{x(t)} 

x(t ) 


x[n] 

X[z] = Z{x[n]} 

1 

m 

(1) 

U[n] 

1 

T 

e- 

S(t - h) 

(2) 


r r " 1 

1 


(3) 

u s [n] 

z 1 

z^T " 1 - z -1 

1 

t u s (t) 

(4) 

nT «,[n] 

fii 
ft -1) 2 

M\ 

t M u s (t) 

(5) 

(nT) M ii, [b] 

S- n “&{7^r) 

1 

e~ a, u s (t) 

(6) 

e-“ T "uAn] = b" ii, [b] 

z - Z e -aT = ^(& = g~ ar ) 

{s' + a) 2 

t e-“‘ uM 

(7) 

nTe~ aT "uAn] 

T ze~ aT 

M\ 

t M e~ al u s (t) 

(8) 

(nT) M e~ aT " ii, [b] 

(-D" 9l, ( M 

(s + a) M+1 

da M \z — e _ “ r / 

CO 

sin cot uM 

(9) 

sin (coTri)u s [ n] 

z sin coT 


z 2 — 2z cos coT + 1 

CO 

e-"’ sin cot u s (t) 

(10) 

e~ aTn sin (coTn)u s [n] 

ze _<Tr sin to r 

(S + CT) 2 + CO 2 

(z — e -<Tr cos coT) 2 + e~ 2aT sin 2 coT 


COS cot U s (t) 

(11) 

cos (coTn)uAn] 

z(z — cos coT) 
z 2 — 2z cos coT + 1 

s + a 

e~ a1 cos cot u s {t) 

(12) 

e~ aTn cos (coTri)u s [n] 

z(z — e~ aT coscoT) 

(s + O') 2 + CO 2 

(z - e~° T cos ®r) 2 + e~^ T sin 2 coT 
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Table B.9 Bilateral z-tran 

sform of basic sequences 

Appendix B 



X[z] = Z[x 

[”]} = HT=-oo x Mz~ n 

with ROC 

(1) 

#0 

1 


All z 

(2) 

S[n-n i] 

z~ n ' All Z 
(form < 

xcept 0 (for m > 0) or oo 

0) 


(3) 

u s [n] 

ijpr 


z\ > 1 

(4) 

-u s [-n- 1] 



z| < 1 

(5) 

= 

a"uAn] ^ = T=k 

~(a = e~° T ) 

z\ > |a| 

(6) 

-b"u s [-n - 

i] 

=1 

2| < 1*1 

(7) 

e~°™ = a H 


-(a = rr" T ) 

a\ < |z| c |3| 

(8) 

nuAn ] 



z| > 1 

(9) 

-nuA-n- 1 

i gfc 


z| < 1 

(10) 

na"uAn] 



z\ > \a\ 

(11) 

-nb"uA~n - 

4 4?- 


z\ < 1*1 

(12) 

n 2 a" uAn] 

HSf 


z| > \a\ 

(13) 

-n 2 V'uA-n ■ 

-H ^0 


z\ < 1*1 

(14) 

n(n—l)—(n—K+2) 

(K-iy. 

’a"- (K ~ 1) uAn ] 


a > w 

(15) 

sin(S2in)Kj[n] 

(z—cos£2i) 2 +s: 

in 2 Qi z 2 — 2zcos£2i+l 

Z|>1 

(16) 

cos(£2in)n s [ri 

1 (z-cosOi) 2 +s: 

ikr = 

Z|>1 

(17) 

r" sin(£2in)« s 

W 

■r 2 sin 2 £2i — z 2 -2zr cos£2i+r 2 

4 > \ r \ 

(18) 

r" cos(f2in)w 

An] - zfe ~ r ‘ os 

SL J (z—r cos ^i) 2 4 

■£2i) _ z(z-r cosfij) 

z\ > M 






Appendix C 

Operations on Complex Numbers, Vectors, 
and Matrices 


C.l Complex Addition 

(fli + jb i) + (a 2 + jb 2 ) = (a i + a 2 ) + j{b x + b 2 ) (C.l) 


C.2 Complex Multiplication 

Rectangular form: (ai + jb]) x ( a 2 + jb 2 ) = (a\a 2 — b\b 2 ) + j(a\b 2 + b\a 2 ) 

(C.2a) 

Polar form: r\Z0\ x r 2 Z& 2 = r 2 e 9 ° 2 = r\r 2 e’ <9 ' + ° 2> = r\r 2 Z(0\ + 0 2 ) 

(C.2b) 


C.3 Complex Division 


Rectangular form: 


jb 2 


Polar form: 


rjAh 

nZ6] 


r 2 e i$2 

riei 01 


«2 + jb 2 
«i + jb i 
a.\a 2 + b\b 2 


ai - jb i 
ai ~ jbi 


-AOi - Oi) 
n 


(C.3a) 


(C.3b) 


C.4 Conversion Between Rectangular Form 
and Polar/Exponential Form 


a r + jcij = rZO = re je with 


| a r + jai\ = J a r + a i and 0 = tan 


(C.4) 
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Here, r and 0 are referred to as the absolute value and argument or phase angle 
of the complex number a r + juj, respectively and j is the unit imaginary number 

7=T. 


C.5 Operations on Complex Numbers Using MATLAB 

If we do not use i and j for any other purpose, they represent the basic imagi¬ 
nary unit V^T by default. Try typing the following statements into the MATLAB 
Command Window: 

»cl= l+2i; c2= 3 - 4 i ; 

»cl*c2, cl/c2 % multiplication/division of complex numbers 
»r=abs(c2) % absolute value of the complex number c2 
»sqrt (real (c2>'"’.j+imag (c2) ~2) % equivalent to the absolute value 
'^th=angle (c2) % phase angle dS. the complex number c2 in radians 
»atan2(imag(c2),real(c2)) % equivalent to the phase angle: 

»imag(log(c2)) % equivalent to the phase angle 
»th*180/pi % radian-to-degree conversion 
»r*exp(j*th) % polar-to-rectangular cor.vers i.on 
ans = 3.0000 - 4.0000i 

>>C= [1+i l-2i; -l+3i —1 — 4i] % a complex matrix 

Cl = 1.0000 + : . OOOOi 1.0000 - 2 . OOOOi 

-1.0000 + 3.00004 :.0000 - 4.OOOOi 

»C1= C' % doiijja&ste transpose 

Cl = 1.0000 - 1. OOOOi -1,0000 - 3.OOOOi 
.0000 + 2.000C i -1.0000 4 4.00001 


C.6 Matrix Addition and Subtraction[Y-l] 



an an • a \n 


~b n 

b\2 

b\N 


Cu Ci2 

C\N 

A + B = 

<221 «22 • 02 N 

+ 

bn 

b 21 

b2N 


C 2 1 C 2 2 

C2N 


JtMl Om 2 ■ a-MN_ 


_b m i 

i>M2 * i>MN_ 


_Cm\ Cm2 

■ CmN_ 


with a mn + b m , 


(C.5a) 

(C.5b) 
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C.7 Matrix Multiplication 


an oi 2 • aiK 

'b n 

b\ 2 ■ b\ N 


c 11 Ci 2 • Cuv 

021 o 22 • a 2K 

b 2 1 

b 22 ■ b 2N 

= 

C21 c 22 ■ C 2N 

_0M1 Om2 • aMK_ 

pK 1 

bK2 ■ b K N_ 


_Cm\ Cm2 • CMN_ 


with c mn = y | a mk b kn (C.6b) 

(cf.) For this multiplication to be done, the number of columns of A must equal the 
number of rows of B. 

(cf.) Note that the commutative law does not hold for the matrix multiplication, i.e., 
AB / BA. 


C.8 Determinant 

The determinant of a K x K (square) matrix A = [a m „] is defined by 

det(A) = \A\ = Y^ k=Q a kn(-\) k+n M kn or ^ =o a™fc(-l) m+ *M m * (C.7a) 

for any fixed 1<n<A'or1<m<A' 


where the minor M kn is the determinant of the (K — 1) x ( K — 1) (minor) 
matrix formed by removing the k\h row and the nth column from A and A kn = 
(— l) k+n M kn is called the cofactor of a kn . 

Especially, the determinants of a 2 x 2 matrix A2 X 2 and a 3 x 3 matrix A3 X 3 are 

det(A 2x2 ) = \ an a12 \=J2* a kn {-1 ) k+n M kn = a n a 22 - a 12 a 21 (C.7b) 

|«21 a 22 \ *—'k=l 


det(A 3x3 ) = 


an a 12 an 
a 2 1 a 22 a 23 


|«31 «32 «33 | 


\a 22 a 23 \ a 2 i a 23 \ \a 2l a 22 \ 

— ai 2 + 013 

«32 033 031 033 031«32 


= on(o 22 a 3 3 — a 23 a 32 ) — a\ 2 (a 2 \a 33 — a 23 a 3 1) + oi 3 (a 2 ia 32 — o 22 a 3 i) 

(C.7c) 


Note the following properties. 

• If the determinant of a matrix is zero, the matrix is singular. 

• The determinant of a matrix equals the product of the eigenvalues of a matrix. 
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• If A is upper/lower triangular having only zeros below/above the diagonal in each 
column, its determinant is the product of the diagonal elements. 

• det (A r ) = det (A); det (AB) = det (A) det (B); det (A -1 ) = 1/det (A) 


C.9 Eigenvalues and Eigenvectors of a Matrix 1 

The eigenvalue or characteristic value and its corresponding eigenvector or charac¬ 
teristic vector of an N x IV matrix A are defined to be a scalar A and a nonzero 
vector v satisfying 


Av = lv«.(A-AJ)v = 0 (v 56 0) (C.8) 

where (A, v) is called an eigenpair and there are N eigenpairs for an NxN matrix A. 

The eigenvalues of a matrix can be computed as the roots of the characteristic 
equation 


| A — A/1 = 0 (C.9) 

and the eigenvector corresponding to an eigenvalue A, can be obtained by substitut¬ 
ing A, into Eq. (C.8) and solve it for v. 

Note the following properties. 

• If A is symmetric, all the eigenvalues are real-valued. 

• If A is symmetric and positive definite, all the eigenvalues are real and positive. 

• If v is an eigenvector of A, so is cv for any nonzero scalar c. 


C.10 Inverse Matrix 

The inverse matrix of a A x K (square) matrix A = [ a mn ] is denoted by A -1 
and defined to be a matrix which is pre-multiplied/post-multiplied by A to form an 
identity matrix, i.e., satisfies 


A x A- 1 = A~ l x A = I 

An element of the inverse matrix A -1 = \a mn \ can be computed as 


(C.10) 


(C.ll) 


where M kn is the minor of a kn and A kn = (—1 ) k+n M kn is the cofactor of a kn . 


1 See the website @http://www.sosmath.com/index.html or http://www.psc.edu/~burkardt/papers/ 
linear_glossary.html. 
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Note that a square matrix A is invertible/nonsingular if and only if 

• no eigenvalue of A is zero, or equivalently 

• the rows (and the columns) of A are linearly independent, or equivalently 

• the determinant of A is nonzero; 


C.ll Symmetric/Hermitian Matrix 

A square matrix A is said to be symmetric, if it is equal to its transpose, i.e., 

A T = A (C.12) 

A complex-valued matrix is said to be Hermitian if it is equal to its complex 
conjugate transpose, i.e., 

A = A* 1 where * means the conjugate. (C.13) 

Note the following properties of a symmetric/Hermitian matrix. 

• All the eigenvalues are real. 

• If all the eigenvalues are distinct, the eigenvectors can form an orthogonal/unitary 
matrix U. 


C.12 Orthogonal/Unitary Matrix 

A nonsingular (square) matrix A is said to be orthogonal if its transpose is equal to 
its inverse, i.e., 


A T A = 7; A t = A -1 (C.14) 

A complex-valued (square) matrix is said to be unitary if its conjugate transpose is 
equal to its inverse, i.e., 


A* T A = /; A* r = A" 1 (C.15) 

Note the following properties of an orthogonal/unitary matrix. 

• The magnitude (absolute value) of every eigenvalue is one. 

• The product of two orthogonal matrices is also orthogonal; ( AB)* T ( AB ) = 
b *t (A *r = /. 
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C.13 Permutation Matrix 

A matrix P having only one nonzero element of value 1 in each row and column is 
called a permutation matrix and has the following properties. 

• Pre-multiplication/post-multiplication of a matrix A by a permutation matrix P, 
i.e., PA or AP yields the row/column change of the matrix A, respectively. 

• A permutation matrix A is orthogonal, i.e., A T A = I. 


C.14 Rank 

The rank of an M x N matrix is the number of linearly independent rows/columns 
and if it equals min (M, N ), then the matrix is said to be of maximal or full rank; 
otherwise, the matrix is said to be rank-deficient or to have rank-deficiency. 

C.15 Row Space and Null Space 

The row space of an M x N matrix A, denoted by 1Z (A), is the space spanned by the 
row vectors, i.e., the set of all possible linear combinations of row vectors of A that 
can be expressed by A T a with an M-dimensional column vector a. On the other 
hand, the null space of the matrix A, denoted by Af (A), is the space orthogonal 
(perpendicular) to the row space, i.e., the set of all possible linear combinations of 
the IV-dimensional vectors satisfying Ax = 0. 

C.16 Row Echelon Form 

A matrix is said to be of row echelon form [W-6] if 

• each nonzero row having at least one nonzero element has a 1 as its first nonzero 
element, and 

• the leading 1 in a row is in a column to the right of the leading 1 in the upper row. 

• All-zero rows are below the rows that have at least one nonzero element. 

A matrix is said to be of reduced row echelon form if it satisfies the above conditions 
and additionally, each column containing a leading 1 has no other nonzero elements. 

Any matrix, singular or rectangular, can be transformed into this form through 
the Gaussian elimination procedure, i.e., a series of elementary row operations, 
or equivalently, by using the MATLAB built-in routine “rref () ”. For example, 
we have 


‘° 01 3 1 row T 2 4 0 " 8 ! division [12 0-41 [120-4' 

A = 2 4 0 —8 -»• 0013 <-U 0013 -»■ 0013 = rref {A) 

1 2 1 —1 J change 1 2 1 -1 J row |_0 0 1 3 J subtraction o 0 0 0 _ 

subtraction 
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Once this form is obtained, it is easy to compute the rank, the determinant, and the 
inverse of the matrix, if only the matrix is invertible. 


C.17 Positive Definiteness 

A square matrix A is said to be positive definite if 

x* T A x > 0 for any nonzero vector x (C.16) 

A square matrix A is said to be positive semi-definite if 

x* T A x > 0 for any nonzero vector x (C.17) 

Note the following properties of a positive definite matrix A. 

• A is nonsingular and all of its eigenvalues are positive, and 

• the inverse of A is also positive definite. 

There are similar definitions for negative definiteness and negative semi-definiteness. 

Note the following property, which can be used to determine if a matrix is 
positive (semi-) definite or not. A square matrix is positive definite if and only if 

(i) every diagonal element is positive and 

(ii) every leading principal minor matrix has positive determinant. 

On the other hand, a square matrix is positive semi-definite if and only if 

(i) every diagonal element is nonnegative and 

(ii) every principal minor matrix has nonnegative determinant. 

Note also that the principal minor matrices are the sub-matrices taking the diagonal 
elements from the diagonal of the matrix A and, say for a 3 x 3 matrix, the principal 
minor matrices are 


an an «13 
a 2 \ a 22 a 23 
«3t a 32 a 33 

among which the leading ones are 

an a\ 2 ai 3 
a 2 \ a 22 a 23 
a 3 i a 32 a 33 _ 


'a n an 
_d 2 \ a 22 _ 
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C.18 Scalar(Dot) Product and Vector(Cross) Product 

A scalar product of two N -dimensional vectors x and y is denoted by x • y and is 
defined by 


x y = | A-„y„=x I y (C.18) 

An outer product of two 3-dimensional column vectors x = [x\ X2 x 3 ] 7 and y 
[ \'i y 2 >’3] 7 is denoted by x x y and is defined by 


*2y3 - *3}’2 

x x y = x 3 yi-xiy 3 

_xiy 2 -x 2 yi 


(C.19) 


C.19 Matrix Inversion Lemma 


[Matrix Inversion Lemma] 

Let A, C and [C -1 + DA~ l B] be well-defined with non-singularity as well 
as compatible dimensions. Then we have 

[A + BCD r 1 = A -1 - A~ x B[C~ l + DA~ l BY l DA~ x (C.20) 


Proof We will show that post-multiplying Eq. (C.20) by [A + BCD ] yields an 
identity matrix. 


[A 1 - A l B[C~ y + DA~ l BY l DA~ l ][A + BCD ] 

= / + A 1 BCD - A l B[C- 1 + DA l B] l D - A l B[C + DA 1 B]~ l DA~ l BCD 
= I + A 1 BCD - A l B[C~ l + DA l B}~ l C~ l CD - A _1 B[C _1 + DA 1 B] 1 DA~ l BCD 
= I + A 1 BCD - A l B[C~ l + DA- l BY l [C~ l + DA~ X B]CD 
= 1 + A 1 BCD - A 1 BCD = I 


C.20 Differentiation w.r.t. a Vector 


The 1st derivative of a scalar-valued function /(x) w.r.t. a vector x = [xi x 2 ] 7 is 
called the gradient of /(x) and defined as 


a//3xr 

9//9x 2 _ 


(C.21) 
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Based on this definition, \ 


n write the following equation. 


Also with an M x N matrix A, we have 


x T Ay = —y t A t x — Ay 


T A 

X A y = 2_, m= i }^ n= i a mn x myn 

Especially for a square, symmetric matrix A with M = N, we have 


The 2nd derivative of a scalar function /(x) w.r.t. a vector x = [x\ X2\ T i 
Hessian of /(x) and is defined as 


H(x) = V 2 /(x) = —/(x) = 


d 2 f/dx\ d 2 f/dx\dx2 
_d 2 f/dx 2 dxi d 2 f/dxj 


Based on this definition, w 


n write the following equation: 


On the other hand, the 1st derivative of a vector-valued function f 
vector x = \x\ X2] 1 is called the Jacobian of /(x) and is defined as 


3/i/9*i 9/i/3 x 2 
3/ 2 /3xi 3/ 2 /3x 2 


(C.29) 
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Appendix D 

Useful Formulas 


sin(/l + 90°) = ± cos.) 

(D.l) 

cos(.t + 90°) = + sin/I 

(D.2) 

sin(.l ± 180°) = - sin.4 

(D.3) 

cos(.4 ± 180“) = - cos/1 

(D.4) 

sin(/l + B) = sin/l cos B ± cos.-l sin/i 

(D.5) 

tan( l + fl) = mA±tanB 

(D.7) 

cos(.4 + B) = cos.4 cosfl + sin A sin/i 

(D.6) 

( ’ 1 +tan/1 tanfi 

sm .1 sin/i = ^(cos(-4-B) - cos(4 + B)! 

(D.8) 

sin. 1 cos B = i{sin(/l + B) + sin(/l-B)} 

(D.9) 

cos.lsinfl = i{sin(/l + B)-sin(/t-fi)} 

(DIO) 

cos A cos B = i{cos(/l + B)+oos(/l-B)} 

(Dll) 

sin/I + sin B = 2sin^^jcosp^j 

(D.12) 

cos/4 + cosB = 2cos(^)cos(^) 

(D.13) 

sin 2 /l=±(l-cos2,4) 

(D.14) 

cos 2 /l =^-(l+cos2/4) 

(D.l 5) 

sin 2/) = 2 sin/I cos.-l 

(D.16) 

cos 2 A =cos 2 /l - sin 2 /l 

= 1—2 sin 2 v4 = 2 cos 2 /1 - 1 

(D.l 7) 

ocos/1-6sin.4 = -Ja 2 +b 2 cos(A+0), i 

9 = tan" 1 

(bin) 

(D.l 8) 

| nsin/l+/>cos.4 = Va 2 +* 2 sin(/l+0), 0 = tan' 1 (6/a) 

(D.19) 

Euler identity: e ij0 = cost? ± j sin 0 

(D.20) 

e' e + e -> 9 = 2cos 0 

(D.21) 

e‘° - e ~‘ B = y 2 sin <9 

(D.22) 

Sum of (infinite) geometric series; X»=< 

„ 1- 



’ 1 


) 

| Binomial expansion: (a + b) N = XiHoJVC I ,a w ""A l 

’with AfC„= NC n .„ = ^= , 

n\ (N-n)\n\ 

(D.24) 

= =' + -*+-**+-r 

“ s0 n! 1! 2! 3! 

' + ■■■ e* = l + jr 

(D.25) 

di' =nl 

(D.26) 

J t’dt = ^y»" +I for n * -1 

(D.32) 

d a, a, 

di* 

(D.27) 

I*”*-If 

(D.33) 

cos cot = -tfjsino* 
dt 

(D.28) 

J cos ml dl = — sinatf 

(D.34) 

d . 

—smart = co cos cot 

(D.29) 

J sin®/ dl = --^cosnrf 

(D.33) 

d . , d x d 

jt (uv) u d v + v di u 

(D.30) 

J = uv - { v^d, (Partial integral) (D.36) 

d (v'] u(dv/dl)-v(du / dl) 

rf/UJ u- 

(D.31) 



(D.37) 

\^x(l)8(l-l t )dl ( ' '^xUi) 

(D.38) 

\~^e“°'dt m = n 2n8(m) 

(D.39) 

z;„e ja,<E3 = 6,, 2tr zr~#(n-2*i) 

(D.40) 
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Appendix E 

MATLAB 


Once you installed MATLAB®, you can click the icon like the one 
at the right side to run MATLAB. Then you will see the MATLAB Su 
Command Window on your monitor as depicted in Fig. E.l, where 
a cursor appears (most likely blinking) to the right of the prompt 
like “>>” waiting for you to type in commands/statements. If you ' ^ 

are running MATLAB of version 6.x or above, the main window has 
not only the command window, but also the workspace and command history 
boxes on the left-up/down side of the command window, in which you can see 
the contents of MATLAB memory and the commands you have typed into the 
Command window up to the present time, respectively (see Fig. E.l). You might 
clear the boxes by clicking the corresponding submenu under the “Edit” menu 
and even remove/restore them by clicking the corresponding submenu under the 
“Desktop/Desktop Layout” menu. 

How do we work with the MATLAB Command Window? 


By clicking “File” on the top menu and then “New”/“Open” in the File pull-down 
menu, you can create/edit any file with the MATLAB editor. 
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- By clicking “File” on the top menu and then “Set_Path” in the File pull-down 
menu, you can make the MATLAB search path list include or exclude the paths 
containing the files you want to or not to be run. 

- If you are a beginner in MATLAB, then it may be worthwhile to click “Help” 
on the top menu, “Demos” in the Help pull-down menu, (double-)click any topic 
that you want to learn about, and watch the visual explanation about it. 

- By typing any MATLAB commands/statements in the MATLAB Command Win¬ 
dow, you can use various powerful mathematic/graphic functions of MATLAB. 

- If you have an M-file which contains a series of commands/statements composed 
for performing a target procedure, you can type in the file name (without the 
extension “.m”) to run it. 


Note the following: 

1) the index of an array in MATLAB starts from 1, not 0, and 

2) a dot(.) must be put before an operator to make a term-wise (element-by- 
element) operation. 


Table E.l Functions and Variables in MATLAB 


function 

Remark 

function 

Remark 

cos(x) 
sin(x) 
tan (x) 

cos- 1 (x) 

exp(x) 
log (x) 
loglO (x) 

exponential function 
natural logarithm 
common logarithm 
absolute value 

asin(x) 

sin” 1 (x) 

angle(x) 

phase of a complex 

atan(x) 

—n/2 < tan -1 (x) < n/2 

sqrt(x) 

number[rad] 
square root 

atan2(y,x 

) -jr < tan -1 (y, x) < n 

real(x) 

real part 

cosh(x) 

(e x + e~ x )/2 

imag(x) 

imaginary part 

sinh(x) 

(e x - e ')/2 

conj(x) 

complex conjugate 

tanh(x) 

(e*-e-*)/(e*+ e -*) 

round (x) 

the nearest integer (round-off) 

acosh(x) 

cosh -1 (x) 

fix(x) 

the nearest integer towards 0 

asinh(x) 

sinh -1 ( x ) 

floor(x) 

the greatest integer < x 

atanh(x) 

tanh -1 (x) 

■ceil (x) 

rounding down 
the smallest integer > x 

max 

maximum and its index 

sign(x) 

rounding up 

1 (positive)/))/-1 (negative) 

min 

minimum and its index 

mod (y, x) 

remainder of y/x 

sum 

sum 

rem (y, x) 

remainder of y/x 

prod 

product 

eval(f) 

evaluate an expression 

norm; 


feval(f,a) 

function evaluation 

sort 

sort in the ascending order 

polyval 

value of a polynomial function 

clock 

present time 

poly 

polynomial with given roots 

find 

index of element(s) 

roots 

roots of polynomial 

tic 

start a stopwatch timer 

toe 

read the stopwatch timer 

da _ 

present date 


(elapsed time from tic) 
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Table E.l (continued) 


function 

Remark 

function 

Remark 

reserved variables with special meaning 

i, j V=T 

pi 

7T 

eps 

machine epsilon (smallest 

Inf, inf 

largest number (oo) 

realmax, 

realmin 

positive number) 
largest/smallest positive 
number 

the end of for-loop or if, while, 

NaN 

break 

Not_aJSTumber(undetermined) 

exit while/for loop 

nargin 

case statement or an array 

# of input arguments 

nargout 

# of output arguments 

varargin 

variable input argument list 

varargoupfe. 

variable output argument list 


Table E.2 Graphic line specifications used in the plot () command 


Line type 

Point type (Marker symbol) 

Color 


- solid line 

.(dot) 

-Kplus) 

’(asterisk) 

r: red 

m: magenta 

: dotted line 

a: A 

>: > 

“(circle) 

g: green 

y: yellow 

- dashed line 

p:* 

v: V 

x: x-mark 

b: blue 

c: cyan(sky blue) 

-. dash-dot 

&.0 

<: < 

s: square(Q) 

k: black 



Some of mathematical functions and special reserved constants/variables defined 
in MATLAB are listed in Table E.l. Table E.2 shows the graphic line specifications 
used in the plot() command. 

E.l Convolution and Deconvolution 


C=conv (A,B) 

- For two sequences A — \a\ ■ ■ ■ a«] and B = [b\ £>2 • • • Aw], this routine 

computes their (linear) convolution C = [c\ C2 • • • C/v+,w-i] as 

E min(n,M— 1) 

a n - m+1 b m+ i (E.l) 

m=max(0,«-W+l) " + 

- It can be used for multiplying two polynomials whose coefficients are A and 
B, respectively: 

{a\x N 1 + • • • + a^-ix + ajv)(Z?ix M 1 + • • • + £>m- ix + bu) 

= CiX N+M ~ 2 H-h C N+ m-2X + C N+ M- 1 

- C=xcorr2 (A,B) performs two-dimensional convolution of matrices A 
and B. 
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function z=conv_circular(x,y,N) 

% Circular convolution z(n)= (1/N) sum_m=0~N-l x(m)*y(n-m) 
if nargin<3, N=min(length(x),length(y)); end 
x=x (1:N) ; y=y(l:N); y crc- £.1 'pi r (y) ; 

joskin 

[y_q#*<N) y.cte‘U:N-l) ] ;'' : #|n) = x*y^||:.'/N; 


[Q,R]=deconv(C,A) 

- This routine deconvolves a vector A out of C by long division to find Q and R 
such that 

C — conv(A, Q) + R 

- It can be used for polynomial division C(x)/ A(x) = Q(x) + R(x)/A(x). 


E.2 Correlation 


[phi,lags]=xcorr(x,y,opt) 


- With no optional parameter opt, this routine computes the (linear) correla¬ 
tion as 

4> xy [m] = _ oo x[n + m]y*[n\ = 

E,,-^ X Wy*[ n ~ m ] 

= Er=-oo X[_ " +m]> '* [_n 

] (E.2) 

together with the corresponding time lag vector lags. 

- With optional parameter opt = “coeff”/“biased”/“unbiased”, it outputs a 
normalized version as Eqs. (1.4.16a)/(1.4.16b)/(1.4.16c), respectively. 

function [phi, lags] =xcorrjny (x, y, opt) 

% computes the crosscorrelation of two vector 

s x and y as phi(1:Nx+Ny-l) 

x=x(:).'; y=y% make them row vectors 
Nx=length(x); Ny=length(y); N=max(Nx,Ny); 

Nl=min(Nx-n,Ny); m=l:Nl; phi(n+Ny)= x(m+n)* 
if opt(1:3)=='unb', phi(n+Ny)= phi(n+Ny)/N1 

N2=min(Nx,Ny+n); m=l:N2; phi(n+Ny)= x(m)*y( 
if opt(1:3)=='unb', phi(n+Ny)= phi(n+Ny)/N2 

if opt(l)=='b', phi= phi/N; % biased version 
elseif opt(l)=='c', phi=phi/sqrt((x*x')*(y*y 

lags=[-(Ny-1):(Nx-1)]; 

; end % regular or unbiased 

m-n)'; 

; end % regular or unbiased 

(1.4.16b) 

')); % coefficient version 
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function phi=xcorr_circular (x, y, N) 

% Circular (cyclic) correlation of x and y with period N 
if nargin<2, y=x; end 
Nx = length(x); Ny = length(y); 
if nargin<3, N=max(Nx,Ny); end 

if Nx<N, X = [x zeros(1,N-Nx)]; elseif N<Nx, x = x(l:N); end 
if Ny<N, y = [y zeros(1,N-Ny)]; elseif N<Ny, y = y(1:N); end 
for n=l:N, phi(n) = x*y'/N; y = [y(N) y(l:N-l)]; end 


PHI=xcorr2(X,Y) 

- Two-dimensional cross-correlation of matrices X and Y 


E.3 CTFS (Continuous-Time Fourier Series) 


function [c, kk] =CTFS_exponential (x, P, N) 

% Find the complex exponential Fourier coefficients c(k) for k=-N:N 
% x: A periodic function with period P 

% P: Period, N: Maximum frequency index to specify the frequency range 
wO=2*pi/P; % the fundamental frequency [rad/s] 
xexp_jkwOt_= [x ' (t) . *exp (-j*k*wO*t) ' ] ; 
xexp_jkwOt= inline (xexp_jkwOt_,'t',' k',' wO') ; 

kk=-N:N; tol=le-6; % the frequency range tolerance on numerical error 
for k=kk 

c (k+N+1) = quadl (xexp_jkwOt, -P/2, P/2, tol, [] ,k,wO) ; % Eq. (2.1.5b) 


E.4 DTFT (Discrete-Time Fourier Transform) 


fttpction [X,ph]=DTFT(x,W,nG) 

% DTFT of x[n] for frequency W regarding the 1st sample as the nO-th one. 

Nt =length (x) )' f)=0 sMt-1; 

if aajegxiMSSy. no — -f ippr (Nt/2) ; end 

X= x*exp(-j*(n+nO)'*W); % Eq.(3.1.1) 

if nargout==2, ph=angle(X); X=abs(X); end 


E.5 DFS/DFT (Discrete Fourier Series/Transform) 


function [X,ph] =f||||(x,fe®) 

% N-point DFS/DFT of x[n] regarding the 1st sample as the nO-th one. 

if nargin<3, nO = 0; end 

n=n0+[0:length(x)-1]; k=[0:N-1]; 

X= x*exp(-j*2*pi*n'*k/N); % Eq.(3.4.7) 

If nargput,“2> pht=a^gtie (X) ; X=abs (X) ; end 
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E.6 FFT (Fast Fourier Transform) 


X=fft (x,N) or fft (x) 

- This routine computes the N-point DFT X(k) of a given sequence x[n], 
where the sequence will be zero-padded or truncated so that its resulting 
length will be N. If the 2nd input argument is not given, the DFT size will 
be set to the length of the sequence. In case the 1st input argument x is a 
matrix, X will also be a matrix, each column of which is the FFT of the 
corresponding column of x. 

- Note that, to exploit the computational efficiency of FFT, the DFT size N 
should be chosen as a power of 2 greater than or equal to the length of the 
sequence. 


x=if ft (X,N) or if ft (X) 

- This routine computes the N-point IDFT x[n] of a given sequence X(k), 
where the sequence will be zero-padded or truncated so that its resulting 
length will be N. If the 2nd input argument is not given, the IDFT size will 
be set to the length of the sequence. In case the 1st input argument x is a 
matrix, x will also be a matrix, each column of which is the IDFT of the 
corresponding column of X. 

- Note that, to exploit the computational efficiency of FFT, the IDFT size N 
should be chosen as a power of 2 greater than or equal to the length of the 
sequence. 


X=fft2(x,M,N) or fft2(x) 

- This routine computes the two-dimensional DFT X(k,l) of a given matrix 
x[m,n], where each column/row of x will be zero-padded or truncated so that 
the resulting matrix size will be M x N. If the 2nd and 3rd input arguments 
are not given, the DFT sizes will be set to the row/column size. In fact, 
“f ft2 (x,M,N)” is equivalent to “fft (fft (x,M) .') ,N) /” 


x=ifft2(X,M,N) or ifft2(X) 

- This routine computes the two-dimensional IDFT x[m,n] of a given matrix 
X(k,l), where each column/row of X will be zero-padded or truncated so that 
the resulting matrix size will be M x N. If the 2nd and 3rd input arguments 
are not given, the IDFT sizes will be set to the row/column size. In fact, 
^i : fft2 (x,M,N)” is equivalent to “if ft (if ft (x,M) .' ) ,N) /” 
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y=fftshift(x) 

- This routine swaps the first and second halves of the input vector x if x is 
a vector and swaps quadrants one and three with quadrants two and four 
if x is a matrix. It is used to rearrange the FFT sequence so that the zero 
(DC) frequency component is located at the center with the negative/positive 
frequency ones on the left/right side. 


E.7 Windowing 


function xw=windo* 

ring(x,w,opt) 


N= length(x); 



if isnumeric(w) 



xw= x; Nw2=floot 

:((N-w)/2); xw(l: 

:Nw2)=0; xw(Nw2+w+l:end)=0; 

else 



switch lower (w(] 

L: 2)) 


case {'bt','tt 

w= bartlett (N) ; % window (bartlett, N) 

case 'bk', w= 

blackman(N); % window(@blackman,N) 

case 'cb', if 

r.a rg : r.<5, r"~l 03 , 

: else r=opt; end 

w= 

chebwin(N,r); % 

window(Schebwin, N, r) 

case 'gs', if 

nargin*3fc. alpha- 

=2.5; else alpha=opt; end 

w= 

gausswin(N,alpha); % window(@gausswin,N,alpha) 

case 'hm', w= 

hamming (N) ; % w: 

Lndow(Shamming, N) 

case 'hn', w= 

hanning(N); % w: 

Lndow(Shanning,N) 

case 'ks', if 

nargin<3, beta=( 

3.5; else beta=opt; end 

w= 

kaiser(N,beta); 

% window(Skaiser, N, beta) 

otherwise w= 

x; 


end 



if size(x,1)==1, 

w=w.'; end 


xw = x.*w; 



end 




(cf.) You can just type “window” or “wintool” into the MATLAB Command win¬ 
dow to open the Window Design & Analysis Tool. Type “doc window/ 
signal”/“doc window” to see other usages of the signal processing toolbox 
or filter design toolbox function “window”. 

E.8 Spectrogram (FFT with Sliding Window) 


[X, F, T] =specgram (x, N, Fs, WND, Noverlap) in MATLAB 6.x 
versions 

- This STFT (Short-Time Fourier Transform) routine computes the spectro¬ 
gram, i.e., N-point DFT X(k,m) of mth segment that is windowed by WND 
and overlaps with neighboring segment by Noverlap (whose default value is 
length(WND)/2), where the length of WND must be greater than Noverlap, 
but not greater than N. 
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- Input 

• WND: Window sequence given as a column vector of length Nw such that 

Noverlap < Nw < = N 

If a scalar is given as WND, a Hamming window of length N is used. 

• N: DFT size whose default value is min(256,length(x)). 

• Fs: Sampling frequency which does not affect the spectrogram but is used 
for scaling plots and its default value is 2 Hz. 

• You can use the default value for any parameter by leaving it off or 
using []. 

- Output 

• X: STFT X(k,m) of x with time and frequency increasing linearly across 
its columns, from left to right and down its rows, starting at 0, respec¬ 
tively. The number of coumns of X will be Nc = fix((length(x)- 
Noverlap)/(length(WND)-Noverlap)). The number of rows of X will 
be Nr = ceil((N + l)/2) or N depending on whether x is real or 
complex-valued. 

• F and T: Nr normalized frequencies (£2/7r) in Hz and Nc times in column 
vectors 

- With no output arguments, the routine plots the absolute value of the spec¬ 
trogram in the current figure, using imagesc(T,F,20*logl0(abs(X))), where 
T is created with its starting point shifted by (Nw-Noverlap)/2. Then “axis 
xy”, and “colormap(jet)” are used so that the low frequency content of the 
first portion of the signal is displayed in the lower left corner of the axes. 

>>±magesc 20*logl0 (abs (X)+eps) ) ; axis xy; colormap (jet) 

(Example) Compute the spectrogram of a quadratic chirp. 

x— chirp (t, 0,1,150,'q'); % quadratic chirp start @ 0 S crosjf at t=l 

N=64; Nhw=N; % The DFT size and the length of the Hanning window 

Noverlap=32; [X,F,T] = specgram(x,N,Fs,Nhw,Noverlap); 

specgram(x,N,Fs,Nhw,Noverlap); % Display the spectrogram 

title('Quadractic Chip: start at 0Hz and cross 150Hz at t=lsec') 


[X, F, T, P ] =spectrogram (x, WND, Noverlap, N, Fs) in MATLAB 

7.x versions 

- This STFT routine computes the spectrogram, i.e., N-point DFT X(k,m) 
of mth segment that is windowed by WND and overlaps with neighboring 
segment by Noverlap. 

- By default, x is divided into eight segments. If x cannot be divided exactly 
into eight segments, it is truncated. Also by default, the DFT size N is set 
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to the maximum of 256 and the next power of 2 greater than the length 
of each segment of x. WND is a Hamming window of length N. Noverlap 
is the value producing 50% overlap between segments. Fs is the sampling 
frequency, which defaults to normalized frequency 1 Hz. 

- Each column of X contains an estimate of the short-term, time-localized fre¬ 
quency content of x. Time increases across the columns of S and frequency 
increases down the rows. 

- The number of rows of X will be Nr = ceil((N + l)/2) or N depending on 
whether x is real-valued or complex-valued. 

- The number of coumns of X will be Nc = fix((length(x)-Noverlap)/ 
(length(WND)-Noverlap)). 

- If WND is given as an integer, x is divided into segments of length WND and 
each segment is windowed by a Hamming window. If WND is a vector, x is 
divided into segments equal to the length of WND and then each segment is 
windowed by the window vector WND. 

- Noverlap must be an integer smaller than WND (an integer) or its length if 
WND is a vector. 

- If the 4th input argument is given as not a scalar meaning the DFT size, but 
a vector of frequency [Hz], spectrogram(x, WND,Noverlap,F) computes the 
spectrogram at the frequencies in F using the Goertzel algorithm. 

- The 2nd output F is the frequency vector of length N and the 3rd output T 
the time vector of length Nc at which the spectrogram is computed, where 
each value of T corresponds to the center of each segment. 

- The 4th output P is a matrix of the same size as x containing the PSD of 
each segment. For real x, each column of P has the one-sided periodogram 
estimate of the PSD of each segment. If x is complex or a frequency vector 
is given as the 4th input, P has the two-sided PSD. 


E.9 Power Spectrum 


[Pxy,F]=cpsd(x,y,WND,Noverlap,Nfft,Fs) 

- This routine computes the one/two-sided CPSD (Cross Power Spectral Den¬ 
sity) estimate Pxy of two real/complex-valued signal vectors x and y using 
Welch’s averaged periodogram method. For real signals, Pxy has length 
(Nfft/2 + 1) if Nfft is even, and (Nfft + l)/2 if Nfft is odd. For complex 
signals, Pxy always has length Nfft. 

- By default, x is divided into 8 sections (with 50% overlap), each of which 
is windowed with a Hamming window and eight modified periodograms are 
computed and averaged. 






430 


Appendix E 


- If WND is a vector, the signal vectors are divided into overlapping sections 
of length equal to the length of WND, and then each section is windowed 
with WND. If WND is an integer, x and y are divided into sections of length 
WND, and a Hamming window of equal length is used. If the length of x and 
y is such that it cannot be divided exactly into integer number of sections 
overlapped by Novelap samples (or 50% by default), they will be truncated 
accordingly. Noverlap must be an integer smaller than WND (given as an 
integer) or the length of WND (given as a vector). 

- Nfft specifies the DFT size used to calculate the CPSD estimate and its 
default value is the maximum of 256 or the next power of 2 greater than 
the length of each section of x (and y). 

- Note that if Nfft is greater than the segment length, the data is zero-padded. 
If Nfft is less than the segment, the segment is “wrapped” to make the length 
equal to Nfft. This produces the correct FFT when Nfft < L, L being signal 
or segment length. 

- If the sampling frequency Fs is not given, F will be the vector of digital 
frequencies in rad/sample at which the PSD is estimated. For real signals, 
F will span the interval [0,pi] when Nfft is even and [0,pi) when Nfft is 
odd. For complex signals, F spans [0, 2*pi). If Fs[Hz] is given as the real 
frequency, F will span the interval [0,Fs/2] when Nfft is even and [0,Fs/2) 
when Nfft is odd. For complex signals, F spans the interval [0,Fs). If Fs is 
given as [] (an empty set), it will be set to 1 Hz so that F will be a vector of 
normalized frequencies. 

- The string “twosided” or “onesided” may be placed in any position in the 
input argument list after Noverlap to specify the frequency range over which 
the CPSD estimated is found. 

- cpsd(..) with no output arguments plots the CPSD estimate in dB per unit 
frequency. 

- cpsd(x,x,...) can be used to find the APSD (auto power spectral density) of 
a signal x, which shows the distribution of signal power per unit frequency. 


(cf.) An interactive GUI (graphic user interface) signal processing tool, named 
“SPTool”, is available. 

E.10 Impulse and Step Responses 


[y, t, x] =impui|Efe (sys, t_f) or [y, x, t ] =impulse (B, A, t_f) 

- This routine returns the impulse response y (t) (together with the time 
vector t starting from 0 to t f and the state history x for a state-space 
model) of an LTI system with transfer function B(s)/A(s) or a system model 
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sys that might have been created with either tf (transfer function), zpk 
(zero-pole-gain), or s s (state space) as below: 

»sys=tf(B,A) % continuous-time system B(s)/A(s) 
»sys=tf (B, A, Ts) %discrete-time system B[z]/A[z] 
with sampling interval Ts 

- For continuous-time systems, the final time or time vector t f can be given 
in the form of t _0 : dt: t_E where dt is the sample time of a discrete approx¬ 
imation to the continuous system. For discrete-time systems, it should be 
of the form t_0:Ts:t_f where Ts is the sampling period. Note that the 
impulse input is always assumed to arise at t = 0 (regardless of t 0). 

- If t_f is not given, the simulation time range will somehow be chosen 
appropriately. 

- [y, x, t ] =lmpulse (B, A, t_f) returns an empty set [] for the 2nd 
output argument x. 

- With no output arguments, the routine plots the impulse response with 
plot () for continuous-time systems and with stair () for discrete-time 
systems. 


[g, t ] =impz (B, A, N, Fs) 

- This computes two N x 1 column vectors, g and t, where g consists of N 
samples of the impulse response of the digital filter B[z]/A[z] and t is the cor¬ 
responding time vector consisting of N sample times spaced Ts = 1 /Fs[s] 
apart. Note that Fs is 1 by default. 

- The impulse response can also be obtained from filter(B,A, [1 
zeros(1,N-l)]) . 

- With no output arguments, the routine plots the impulse response using 
stem(t,g). 


[y, x] =dimpulse (A, B, C, DylU, N) or y=dimpuis(S,:(B, A, N) 

- This returns N samples of the impulse response in y (together with the state 
history x for a state-space model) of a discrete-time LTI system described 
by state-space model (A,B,C,D) or transfer function B[z]/A[z] to the unit 
impulse input (applied to the IUth input terminal), where the state-space 
model is given as 

x[n + 1] = Ax[n] + Bu[n] 
y[n] = Cx[n] + Du[n] 
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[y,t,x]=step(sys,t_f) or [y,x,t]=step(B,A,t_f) 

- This routine returns the step response y (t ) (together with the time vector t 
starting from 0 to the final time t f and the state history x for a state-space 
model) of the LTI model sys that might have been created with either tf 
(transfer function), zpk (zero-pole-gain), or ss (state space). 

- For a continuous-time system, t_f can be given as a time vector in the form 
of t_0 : dt: t_f where dt is the sample time of a discrete approximation 
to the continuous system. For a discrete-time system, it can be given in the 
form of t 0 : Ts : t f where Ts is the sampling interval. Note that the unit 
step input is always assumed to arise at t = 0 (regardless of t 0). 

- If the final time or time vector t_f is not given, the simulation time range 
and number of points will somehow be chosen appropriately. 

- [y, x, t ] =step (B, A, tJfT returns an empty set [] for the 2nd output 
argument x. 

- With no output arguments, the routine plots the step response with plot () 
for continuous-time systems and with stair () for discrete-time systems. 


[y, x] =dstep (A,R,C,D, 7'J,N) or y=dstep (B, A, N) 

- This returns N samples of the step response in y (together with the state 
history x for a state-space model) of a discrete-time LTI system described 
by state-space model (A,B,C,D) or transfer function B[z]/A[z] to the unit 
step input (applied to the IUth input terminal). 


[y, t, x] =lsim(sys,u,t, xO) 

- This routine returns the time response (together with the time vector t and 
the state history x) of the LTI system sys (with the initial state xO at time t(l) 
for state-space models only) to the input signal u(t) where the input matrix 
u has as many columns as the input coefficient matrix B and its ith row 
specifies u(t(i)) where sys=ss(A,B,C,D). 

- For discrete-time systems, u should be sampled at the same rate as sys and 
in this case, the input argument t is redundant and can be omitted or set to 
the empty matrix. 

- For continuous-time systems, choose the sampling period t(n + 1) — t(n) 
small enough to describe the input u accurately. 


[y,x]=dlsim(A,B,C, D, u, xO) or y=dlsim(B, A, u) 

- This routine returns the time response (together with the state history x) 
of a discrete-time LTI system described by state space model (A,B,C,D) or 
transfer function B[z]/A[z] (with the initial state xO for state-space models 
only) to the input signal u[n] where the input matrix u has as many columns 
as the input coefficient matrix B. 
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E.ll Frequency Response 


G=f reqs (B, A, w) (w : analog frequency vector[rad/s]) 

- This routine returns the frequency response of a continuous-time system by 
substituting s = jco (co = w) into its system function G(s) = B(s)/A(s) — 
{b\s NB ~ l + ■ ■ ■ + b NB )/iais NA ~ l + • • • + 


G{co) = G(s)\^ J0J 


b\s NB 1 + • • • + buB-\s + bus 
ais NA ~ l -\ -1- a NA -is + a NA s=j<0 


(E.3a) 


G=f reqz (B, A, W) (W : digital frequency vectorfrad/sample]) 

- This routine returns the frequency response of a discrete-time system by 
substituting z = e jn (J2 = W) into its system function G[z] = 5[z]/A[z] = 
(b\ -I-+ b NB z~ (NB ~ l) )/{a\ + • • • + aAfAZ _(ArA_1) ): 


G(£2) = G[z]\ z=ei * 


bi + b 2 z~ 1 + • • • + b NB z~ (NB ~ l) 
a\ + a 2 z~ l + -h a NA z- (NA ~ X) z=ei u 


(E.3b) 


[G,W]=freqz(B,A,N) 

(with N: number of digital frequency points around the upper half of the unit 
circle) 

- This routine returns the frequency response of a discrete-time system by 
substituting z = e' n ‘ (£2k = 2kit/N with k = 0 : N — 1) into its system 
function G\z\ — B\z\/A\z] where the 2nd output argument is a column 
vector consisting of {£2* = kit/N, k = 0 : IV — 1}. 


[G,W]=freqz(B,A,N,'whole') 

(with N: number of digital frequency points around the whole unit circle 

- This routine returns the frequency response of a discrete-time system by 

substituting z = (£2* = 2kit/N with k = 0 : N — 1) into its system 

function G[z\ = B[z\/A[z]. 

G=f reqz (B, A, f, f s ) (with f: digital frequency vector in Hz, fs: sampling 

frequency in Hz) 

- This routine returns the frequency response of a discrete-time system by 
substituting z — e jQ (£2 = 2nf/f s ) into its system function G[z] = 
B[z]/A[z]. 
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E.12 Filtering 


[y,wf]=filter(B, A, x, wO) or 

[y,wf]=filter (Gd.structure,x,wO) 


- This routine computes the output y (together with the final condition wf) 
of the digital filter G[z] = B[z]/A[z] = {b x + • • • + W (WB_1) )/(«i + 
• • • + a NA z~ (NA ~ !) ) (described by numerator B and denominator A or a fil¬ 
ter structure constructed using dfilt ()) to the input x (with the initial 
condition wO). 

- Let every filter coefficient be divided by a\ for normalization so that we have 
the system function of the digital filter as 


G[z] = 


bi+b 2 z- l + --- + b NB z- {NB ~ 1 > 
a\ + a 2 z~ l H-b a NA z~ (NA ~ X) 


bt/ai-*bi b\ + b 2 Z 1 + ' ' ' + b^BZ NB ^ 
a./ai^a, 1 + a 2 Z H-b a NA Z~ (NA ~ 1) 


(E.4) 



Fig. E.2 Implementation of an FIR filter in the transposed direct form II structure 


The difference equation describing the input-output relationship of the filter 

y[n] = -a 2 y[n- 1]- a NA y[n-N A+\]+b\x[n]-\ - \-b NB x[n-NB+l] 

(E.5) 

is implemented in the transposed direct form II structure (Fig. E.2) as 

y[n] = wi[n - l]+bix[n] 

w\ [n] = w 2 [n — 1] — a 2 y[n\ + b 2 x[n] 


Wn-iW = W N -\[n - 1] - aiv-iyM + ^jv-i^[«] 
w N -i[n] = -a N y[n] + b N x[n] 

where N = ma x(NA, NB) and the initial condition vector wO of 
length N — 1 can be determined from the past output/input by using 

wO=filtic(B,A,yp,xp). 
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- When the input x is given as an L x M matrix, filter () operates on 
each column of the input matrix. If the initial state wi is nonzero, it must be 
given as an (N — 1) x M matrix where N = max(/V A , NB). The following 
program illustrates how to apply it to obtain the output(s) of a filter with 
some initial states sample by sample: 



- This routine computes the output Y of the 2-D (two-dimensional) FIR filter 
described by matrix B where most of its work is done by using conv2. 
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E.13 Filter Design 
E.13.1 Analog Filter Design 


[N,wc]=buttord(wp, ws, Rp, As, ' s' ) 

- This routine selects the lowest order N and cutoff frequency wc of analog 
Butterworth filter that has the passband ripple<= Rp[dB] and stopband 
attenuation>= As[dB] for the passband edge frequency wp[rad/s] and 
stopband edge frequency ws[rad/s]. (Sect. 7.1) 

- The cutoff frequency is the frequency at which the magnitude response is 

1/V2. 

- Note that for BPF/BSF, the passband edge frequency wp and stopband edge 
frequency ws should be given as two-element vectors like [wpl wp2] and 
[wsl ws2]. 


[B,A]=butter(N,wc,'s') 

- This routine designs an analog Butterworth filter, returning the numera¬ 
tor/denominator of system function of designed filter. 

- [B, A] =butter (N, wc, ' s' ) for an analog LPF of order N with cutoff 
frequency wc[rad/s] 

- butter (N, [wcl wc2] , ' s' ) for an analog BPF of order 2N with 
passband wcl < w < wc2 [rad/s] 

- butter (N, [wcl wc2 ],'stop','s') for an analog BSF of order 2N 
with stopband wcl < w < wc2 [rad/s] 

- butter (N, wc, ' high' , ' s' ) for an analog HPF of order N with cutoff 
frequency wc[rad/s] 

- Note that N and wc can be obtained from 

[N, wc] =buttord (wp, ws, Rp, As, ' s' ). 


[B, A] =chebyl (N, Rp, wpc, ' s' ) 

- This routine designs an analog Chebyshev type I filter with passband rip¬ 
ple Rp[dB] and critical passband edge frequency wpc (Use Rp = 0.5 as a 
starting point, if not sure). 

- Note that N and wpc can be obtained from 

[N, wpc] =chebylord (wp, ws, Rp, As, ' s' ) . 


[B, A] =cheby2 (N, As, wsc, ' s' ) 

- This routine designs an analog Chebyshev type II filter with stopband atten¬ 
uation As[dB] down and critical stopband edge frequency wsc (Use As = 20 
as a starting point, if not sure). 

- Note that N and wsc can be obtained from 

[N, wsc]=cheby2ord(wp,ws,Rp,As,'s'). 
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[B,A]=cllip(N,Rp,As,wpc, 's') 

- This routine designs an analog Elliptic filter with passband ripple Rp, 
stopband attenuation As, and critical passband edge frequency wpc (Use 
Rp = 0.5[dB] & As = 20[dB], if unsure). 

- Note that N and wpc can be obtained from 

&J0. ipord (wp, ws, Rp, As,'s' ) . 


E.13.2 Digital Filter Design - HR (Infinite-duration Impulse 
Response) Filter 


[N, fc] =buttord (fp, fs, Rp, As) 

- This routine selects the lowest order N and normalized cutoff frequency fc of 
digital Butterworth filter that has passband ripple <= Rp[dB] and stopband 
attenuation>= As[dB] for passband edge frequency fp and stopband edge 
frequency fs. 

- The cutoff frequency is the frequency at which the magnitude response is 

1/V2. 

- As far as digital filter is concerned, every digital frequency £2, = (o,T = 
2nfiT [rad/sample] should be divided by n so that it can be normalized 
into the range [0, 1] where 1.0 corresponds to the digital frequency n 
[rad/sample]. 

- Note that for BPF/BSF, the passband edge frequency fp and stopband edge 
frequency fs should be given as two-dimensional vectors like [fpl fp2] and 
[fsl fs2]. 


[B,A]=butter(N, fc) 

- This routine designs the system function of digital Butterworth filter. 

- [B, A] =butte.r (N, fc): digital LPF of order N with cutoff frequency fc 

- butter (N, [ f cl f c2 ] ): digital BPF of order 2N with passband fcl < 
f <fc2 

- butter (N, [fcl fc2] , ' stop' ): digital BSF of order 2N with stop- 
band fcl < f < fc2 

- butter (N, fc, ' high' ): digital HPF of order N with cutoff fre¬ 
quency fc 

- Note that N and fc can be obtained from 
[N, fc] =buttord (fp, f s, Rp, As) . 
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[B, A] =chebyl (N, Rp, fpc, opt) 

- This routine designs a digital Chebyshev type I filter with passband ripple 
Rp[dB] and critical passband edge frequency fpc (Use Rp = 0.5 as a starting 
point, if not sure). 

- Note that N and fpc can be obtained from 

[N, fpc] =chebylord (fp, fs, Rp, As). 


[B, A] =cheby2 (N, As, fsc, opt) 

- This routine designs a digital Chebyshev type II filter with stopband attenu¬ 
ation As[dB] down and critical stopband edge frequency fsc (Use As = 20 
as a starting point, if not sure). 

- Note that N and fsc can be obtained from 

[N,fsc]=cheby2ord(fp,fs,Rp,As). 


[B, A] =ellip (N, Rp, As, fpc, opt) 

- This routine designs a digital elliptic filter with passband ripple Rp, stopband 
attenuation As, and critical passband edge frequency fpc (Use Rp = 0.5[dB] 
and As = 20[dB], if unsure). 

- Note that N and fpc can be obtained from ellipord (fp, f s, Rp, As). 


E.13.3 Digital Filter Design - FIR (Finite-duration Impulse 
Response) Filter 


B=i|i:l (N, f c , opt) 

- This designs a linear-phase FIR filter by using the windowing method. 
(Sect. 7.2.2.1) 

- The normalized cutoff frequency fc must be between 0 and 1, with 1.0 cor¬ 
responding to the digital frequency n [rad/sample] or half the sampling rate. 

- B=firl(N,fc) designs an N th order lowpass FIR filter with linear phase 
and returns the (real-valued) filter coefficients in a row vector B of length 
N + 1 where the normalized gain of the filter at fc is —6 dB. 

- B=firl (N, f c,' high' ) designs an Nth order highpass FIR filter. 

- If fc is a two-element vector such as fc = [fcl fc2], firl (N, fc) 
designs an Nth order BPF with passband fcl < f < fc2, while 
firl (N, fc, ' stop' ) designs a bands top filter. 

- If fc is a multi-element vector such as fc = [fcl fc2 fc3 fc4... fcM], it 
designs an Nth order multi-band filter with bands 0 < f < fcl, fcl < 
f < fc2, ..., fcM < f < 1. Note that, depending on the value of 
a trailing input argument opt = “DC-1” or “DC-0”, it makes the first 
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band a passband or stopband, that is, B=firl (N, fc, ' DC-1' ) and 
B=firl (N, fc, 'DC-0' ) make the first band a passband and a stopband, 
respectively. 

- B=firl (N, fc, WND ) designs an Nth order FIR filter using the N + 1 
length vector WND to window the impulse response. If empty or omit¬ 
ted (by default), firl uses a Hamming window of length N + 1. Other 
windows such as Boxcar, Hann, Bartlett, Blackman, Kaiser, and Cheb- 
win can be specified with an optional trailing argument. For example, 
firl (N, fc, chebwin (N+l, R) ) uses a Chebyshev window. 

- For filters with a non-zero gain at fs/2 (half the sampling rate corresponding 
to the digital frequency n), e.g., HPF and BSF, N must be even. If N is an 
odd number for HPF or BSF, it will be incremented by one to make the filter 
order even and the window length will be N + 2. 

- By default, the filter is scaled so that the center of the first passband has a unit 
magnitude after windowing. To prevent this scaling, use a trailing ’noscale’ 
argument as illustrated by 

f frl (N, fc, ' high', ''noscale' ) and 
(N, f c , WND, ' r. o s ca e'). 


B=’ftr-2 (N, F, A) 

- This designs a FIR filter by using the frequency sampling method. (See 
Example 7.4) 

- B=fir2 (N, F, A) designs an Nth order FIR filter with the frequency 
response specified by frequency vector F and amplitude vector A, and 
returns the filter coefficients in a row vector B of length N + 1. 

- Vectors F and A specify the frequency and magnitude breakpoints such that 
plot(F,A) would show a plot of the desired frequency response, where the 
frequencies in F must be between 0.0 < F < 1.0 (with 1.0 corresponding 
to half the sample frequency) and must also be in increasing order starting 
from 0.0 and ending with 1.0. 

- The filter B is real, and has linear phase, consisting of symmetric coefficients 
obeying B(k) = B(N + 2 — k) for k = 1,2,..., N + 1. 

- By default, fir2 windows the impulse response with a Hamming window. 
Other windows can be specified with an optional trailing argument. 

- For filters with a non-zero gain at fs/2 (half the sampling rate corresponding 
to the digital frequency : r), e.g., HPF and BSF, N must be even. If N is an 
odd number for HPF or BSF, it will be incremented by one to make the filter 
order even and the window length will be N + 2. 


B=fi.rpm (N, F, A) 

- This designs a Parks-McClellan optimal equiripple FIR filter with desired 
frequency response. 
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- B=firpm (N, F, A) returns a length N + 1 linear phase (real, symmet¬ 
ric coefficients) FIR filter which has the best approximation to the desired 
frequency response described by F and A in the minimax sense that the 
maximum error is minimized. 

- F is a vector of paired frequency band edges in ascending order between 
0 and 1 (with 1.0 corresponding to half the sample frequency). A is a real 
vector (of the same size as F) specifying the desired amplitude of the fre¬ 
quency response, which is the line connecting the points (F(k),A(k)) and 
(F(k+1), A(k+1)) for odd k where the bands between F(k+1) and F(k+2) 
for odd k is treated as “transition bands” or “don’t care” regions. 

- For filters with a non-zero gain at fs/2 (half the sampling rate corresponding 
to the digital frequency n), e.g., HPF and BSF, N must be even. If N is an 
odd number for HPF or BSF, it will be incremented by one to make the filter 
order even. Alternatively, you can use a trailing ‘h’ flag to design a type 4 
linear phase filter (Table 7.2) and avoid incrementing N. 

- B=firpm (N, F, A, W) uses the weights in W to weight the error 
where W has one entry per band (so it is half the length of F and A) which 
tells fripm() how much emphasis to put on minimizing the error in each band 
relative to the other bands. 

- B=firpm (N, F, A, 'h') and B=firpm (N, F, A, W, 

'Hilbert' ) design filters having odd symmetry, that is, 

B(k) = —B(N + 2 — k) for k = 1, ..., N + 1. A special case is a 
Hilbert transformer having an approximate amplitude of 1 across the entire 
band, which will be designed by the following statement: B=f i rpm (30, 
[.1 .9], [11], 'Hilbert'). 

- B=firpm (N, F, A, 'd') and B=firpm (N, F, A, W, 

'differentiator' ) also design filters having odd symmetry, but with 
a special weighting scheme for non-zero amplitude bands. The weight is 
assumed to be equal to the inverse of frequency times the weight W. Thus 
the filter has a much better fit at low frequency than at high frequency. This 
designs FIR differentiators. 

- firpm() normally designs symmetric (even) FIR filters while 
firpm(.. .,‘h’) and firpm(.. .,‘d’) design antisymmetric (odd) filters. 


3 flf[ s (N, F, A) 

- This designs a linear-phase FIR filter using a least-squares error (LSE) 
method. 

- Everything is the same with f irpm (). 
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B fj.:rcls (N, F, A, ub, lb) 

- This designs a length N + 1 linear-phase FIR multi-band filter (with the fre¬ 
quency response amplitude A upperbounded/lowerbounded by ub/lb) using 
a constrained LSE. 

- F is a vector of normalized transition frequencies in ascending order from 0 
to 1 (corresponding to half the sampling rate), whose length is one plus the 
number of bands, i.e., length(A) + 1. 

- A, ub, and lb are vectors of length(F)-1 piecewise constant desired frequency 
response amplitudes and their upper/lower bounds for each band. 

(Ex) B=fircls ! LCV [0 0.4 0.8 1], [0 10], [ 0 '•: . 02.0.01], 

[-0.02‘.f. 98 -0.01]) 


B=firclsl (N, fc, rp, rs, opt) 

- This designs a length N + 1 linear-phase FIR LPF/HPF (with the cut¬ 
off frequency fc) using a constrained LSE method where rp/rs specify the 
passband/stopband ripple, respectively. 

- With opt='high', it designs a HPF. 

(Ex) B=firclsl (10, 0.7, 0.02, 0.01, 'high') 


(cf.) The GUI signal processing tool “sptool” manages a suite of four other GUIs: 
signal browser, filter designer, fvtool (for filter visualization), and spectrum 
viewer where “fdatool” is for filter design and analysis. 


E.14 Filter Discretization 


[Bz,Az]=impinvar (Bs, As, fs, tol) 

- This uses the impulse-invariant method (Sect. 6.2.1) to convert a continuous¬ 
time system G(s) — B(s)/A(s) into an equivalent discrete-time system 
G[z] = B\z.]/A\z\ such that the impulse response is invariant except for 
being scaled by Ts = 1 /fs. 

- If you leave out the argument fs or specify it as the empty vector [], its 
default value 1 Hz will be taken. 

- The fourth input argument tol specifies the tolerance to determine whether 
poles are repeated. A larger tolerance increases the likelihood that 
imp invar () interprets closely located poles as multiplicities (repeated 
ones). The default is 0.001, or 0.1% of a pole’s magnitude. Note that the 
accuracy of the pole values is still limited to the accuracy obtainable by the 
roots () function. 
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[Bz, Az ] =bi.linear (Bs, As, fs, fp) 

- This uses the bilinear transformation (BLT) method (Sect. 6.3.5) to convert 
a continuous-time system G(s) = B(s)/A(s) into its discrete equivalent 
G[z\ = B\z\/A\z\ such that the entire LHP on the s-plane maps into the 
unit circle on the z-plane in one-to-one correspondence. 

- The numerator/denominator polynomial vector Bs and As of an analog fil¬ 
ter are written in descending powers of s and the numerator/denominator 
polynomial vector Bz and Az of the discrete-time equivalent are written in 
descending powers of z (ascending powers of z -1 ). 

- The optional parameter fp[Hz] specifies a prewarping match frequency for 
which the frequency responses before and after BLT mapping match exactly. 


sysd=c2d (sysc, Ts, method) 

- This converts a continuous-time system (transfer) function sysc (that might 
have been created with either tf (transfer function), zpk (zero-pole-gain), 
or ss (state space)) into an equivalent discrete-time system function sysd 
with the sampling interval Ts[s] by using the discretization method among 
the following: 

‘zoh’ : Zero-order hold on the inputs (by default) - Sect. 6.2.2 
‘foh’ : Linear interpolation of inputs (triangle approximation) 

‘imp’ : Impulse-invariant discretization - Sect. 6.2.1 
‘tustin’ : Bilinear (Tustin) approximation - Sect. 6.3.5 
‘prewarp’ : Tustin approximation with frequency prewarping where the 
critical frequency Wc (in rad/s) is specified as fourth input, 
e.g., as sysd = c2d(sysc,Ts,‘prewarp’,Wc) 

‘matched’ : Matched pole-zero method (for SISO systems only) - 
Sect. 6.3.6 

[Ad,Bd]=c2d (Ac, Be, Ts) 

- This converts a continuous-time state equation x’(t) = Ac*x(t) + Bc*u(t) 
into the zero-order-hold (z.o.h.) equivalent discrete-time state equation x[n+ 
1] = Ad*x[n] + Bd*u[n] with the sampling interval Ts[s], (Sect. 8.4.1) 


sysc=d2c (sysd, method) 

- This converts a discrete-time system function into an equivalent continuous¬ 
time system function. 
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E.15 Construction of Filters in Various Structures Using dfilt() 


[SOS,Kc]=tf2sos(B,A); % Transfer function B(s)/A(s) to Cascade (Chap. 7) 

Gd=dfilt.dfIsos(SOS,Kc); % Cascade to Direct I form 

Gd=dfilt.dfltsos(SOS,Kc); % Cascade to Direct I transposed form 

Gd=dfilt.df2sos(SOS,Kc); % Cascade to Direct II form 

Gd=dfilt.df2tsos(SOS,Kc); % Cascade to Direct II transposed form 

Gd=dfilt.dffir(B); % FIR transfer function to Direct form 

Gd=dfilt.dfsymfir(B); % FIR transfer function to Direct symmetric form 

Gd=dfilt.dfasymfir(B); % FIR transfer function to Direct asymmetric form 

Gd=dfilt.latticearma(r,p); % Lattice/Ladder coefficients to lattice ARMA 

Gd=dfilt.latticeallpass(r); % Lattice coefficients to lattice Allpass 

Gd=dfilt.latticear(r); % Lattice coefficients to lattice Allpole 

Gd=dfilt.latticemamax(r); % Lattice coefficients to lattice MA max-phase 

Gd=dfilt.latticemamin(r); % Lattice coefficients to lattice MA min-phase 

[A,B,C,D]=tf2ss(B,A); G_ss=dfilt.statespace(A,B,C,D); % State space 

G_cas= dfilt.cascade(Gdl,Gd2); % Cascade structure 

G_par= dfilt.parallel(Gdl,Gd2); % Parallel structure 


%sigApE_01 .m: % To practice using dfilt() 

Fs=5e4; T=l/Fs; % Sampling frequency and sampling period 
wsl=2*pi*6e3; wpl=2*pi*le4; wp2=2*pi*12e3; ws2=2*pi*15e3; Rp=2; As=25; 
fp=[wpl wp2]*T/pi; fs=[wsl ws2]*T/pi; %Normalize edge freq into [0,1] 

[N,fc]=cheblord(fp,fs,Rp,As) % Order & critical passband edge freq 
[B,A]= chebyl(N,Rp,fc) % numerator/denominator of Chebyshev I BPF 
fn=[0:511]/512; W=pi*fn; 

plot(fn,20*logl0(abs(freqz(B,A,W))+eps)) % Frequency response 
[SOS,Kc]= tf2sos(B,A) % Cascade form realization 
[BBc,AAc]= tf2cas(B,A) % Alternative 

[BBp,AAp,Kp]= tf2par_z (B, A) % Parallel form realization: dir2par(B,A) 
[r,p]= tf21atc(B,A) % Lattice/Ladder coefficients of lattice filter 
G_dflsos= dfilt.dfIsos(SOS,Kc); % Direct I form (Fig. 7.23(a)) 
pause, plot (fn, 20*logl0 (abs (freqz (G_dflsos,W) ) +eps) , ' r' ) 

G_dfltsos=dfilt.dfltsos(SOS,Kc); % Direct I transposed form (Fig.7.23 (b)) 
pause, plot (fn, 20*logl0 (abs (freqz (G_df ltsos, W) ) +eps) ) 

G_df2sos= dfilt.df2sos(SOS,Kc); % Direct II form (Fig. 7.23(c)) 
pause, plot (fn, 20*logl0 (abs (freqz (G_df2sos,W) ) +eps) ,' r' ) 

G_df2tsos=dfilt.df2tsos(SOS,Kc); %Direct II transposed form (Fig.7.23(d)) 
pause, plot (fn, 20*logl0 (abs (freqz (G_df2tsos, W) ) +eps) ) 

G_latticeARMA= dfilt.latticearma(r,p); % Lattice ARMA (Fig.7.23(e)) 
pause, plot (fn, 20*logl0 (abs (freqz (G.latticeARMA, W) ) +eps) , ' r' ) 
[A,B,C,D]=tf2ss(B,A); G_ss=dfilt.statespace(A,B,C,D); % State space 
pause, plot (fn, 20*logl0 (abs (freqz (G_ss, W) ) +eps) ,'m' ) 

Gl=dfilt.df2tsos(BBc(1,:),AAc(1,:)); G2=dfilt.df2tsos(BBc(2,:),AAc(2,:)); 
G3=dfilt.df2tsos(BBc(3,:),AAc(3,:)) 

G_cascade= dfilt.cascade(Gl,G2,G3); % Cascade form 
plot(fn,20*logl0(abs(freqz (G_cascade,W))+eps)), hold on 

Gl=dfilt.df2tsos(BBp(1,:),AAp(1,:)); G2=dfilt.df2tsos(BBp(2,:),AAp(2,:)) 
G3=dfilt.df2tsos(Kp, 1) ; 

G_parallel= dfilt.parallel(Gl,G2,G3); % Parallel form 
pause, plot (fn, 20*logl0 (abs (freqz (G-parallel, W) ) +eps) , ' r' ) 
G_latticeAR_allpass=dfilt.latticeallpass (r); %Lattice Allpass Fig.7.23(f) 
G_latticeAR_allpole= dfilt.latticear (r); % Lattice Allpole Fig.7.23(f) 
G_dffir= dfilt.dffir(B); 

G_dfsymfir= dfilt.dfsymfir(B); G_dfasymfir= dfilt.dfasymfir(B); 

G_latticeMA_maxphase=df ilt. latticemamax (r) ; % MA max phase Fig. 7.23(g) 
G_latticeMA_minphase= dfilt. latticemamin (r) ; % MA min phase Fig. 7.23(g) 
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E.16 System Identification from Impulse/Frequency Response 


[B, A] =prony (g, NB, NA) 


- This identifies the system function 

£|- j 5[z] b\ + Z?2Z 1 + • • • + bf/B+iz N ‘ 

' (E.6) 

A[z] a\ + a,2Z~ l H-+ a N A+iz~ N ‘ 










448 


Appendix E 


of a discrete-time system from its impulse response g[n], 

- The outputs B and A are numerator and denominator polynomial coefficient 
vectors of length NB + 1 and NA + 1, respectively. 


[B,A]=stmcb (g, NB, NA, Nj/fier,. Ai) or stmcb (y, x, NB, 
NA, Niter, Ai) 

- This identifies the system function G[z] — B[z]/A[z] of a discrete-time 
system from its impulse response g[n\ or its output y[n] and input x\n\ 
optionally with Niter (5 by default) iterations and initial estimate of the 
denominator coefficients Ai where y and x are of the same length. 


G=tfe (x, y, N, fs, WND, Noverlap) 

- This estimates the transfer function as frequency response G[Q] = 
Y\QY[/X[Q.} of a discrete-time system from its input x[n] and output y[ri\ 
optionally with N-point DFT (N = 256 by default), sampling frequency 
fs (2Hz by default), windowing sequence WND, and with each section 
overlapped by Noverlap samples. 


[B,A]=invfreqs (G, w, NB, NA, wt. Niter, tol) 
- This identifies the system function 


B{S) _ b X S NB + b 2 S NB ~ l + ■ • • + b, yg+i 
A(s ) a\s NA + a 2 s NA ~ 1 H-h a NA+ i 


(E.7) 


of a continuous-time system from its frequency response G(w)(G(cu)) speci¬ 
fied for an analog frequency vector w(o>) optionally with a weighting vector 
wt (of the same length as w), within Niter iterations, and with fitting error 
tolerance tol. 


[B, A] =invfreqz (G, W, NB, NA, wt. Niter, tol). 

- This identifies the system function G[z] — B\z]/A\z] of a discrete-time 
system from its frequency response G(W)(G(f2) = G[e' n ]) specified for a 
digital frequency vector W(£2)(0 < £2 < n) optionally with a weighting 
vector wt (of the same length as W), within Niter iterations, and with fitting 
error tolerance tol. 
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E.17 Partial Fraction Expansion and (Inverse) 
Laplace/z- Transform 


[ r, p, k] =residue (B, A) or [B, A] Residue (r>. p, k) 


- This converts a rational function B(s)/A(s), i.e., a ratio of numera¬ 
tor/denominator polynomials to partial fraction expansion form (or pole- 
residue representation), and back again. 


B(s) 
A(s ) 


( N-l-L \ 

T —) + — + --- + 7 ^ E ^ 

^ S-Pn) S-p ( S- P ) L 


where the numerator vector r and pole vector p are column vectors and the 
quotient polynomial coefficient vector k is a row vector. 


[r,p,k]=residuez (B, A) or [B,A]=residuez (r,p,k) 

- This converts a rational function B[z]/A[z], i.e., a ratio of numera¬ 
tor/denominator polynomials to partial fraction expansion form (or pole- 
residue representation), and back again. 

B[z\ 

A[zl 


where the numerator vector r and pole vector p are column vectors and the 
quotient polynomial coefficient vector k is a row vector. 


Xs==lap 1 acc (xt) and xt=ilaplsce (Xs) 

- These MATLAB commands compute the symbolic expressions for the 
Laplace transform X(s) = C{x(t)\ of a symbolic function in t and the 
inverse Laplace transform x(t ) = C ' \X(s)} of a symbolic function in s, 
respectively. 


^fxf —) + — + --- + r^4+^ ) (E.9) 
\ “ z-p) Z-p ( Z-p) L 


Xz=ztrans (xn) andxn=iztrans (Xz) 

- These MATLAB commands compute the symbolic expressions for the 
z -transform X[z] = Z{x[n]} of a symbolic function in n and the inverse 
z -transform x\n ] = Z~ 1 [X[z]} of a symbohc function in z, respectively. 
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function x=ilaplace_my (B, A) 

% To find the inverse Laplace transform of B(s)/A(s) using residue() 

% Copyleft: Won Y. Yang, wyyang53@hanmail.net, CAU for academic use only 
if "isnumeric(B) 

[B,A]=numden(simple(B)); B=sym2poly(B); A=sym2poly(A); 

[r,p,k]= residue(B,A); EPS = le-4; 

N= length(r); x=[]; n=l; 

if n<N & abs(imag(p(n)))>EPS & abs(sum(imag(p([n n+l]))))<EPS 

sigma=real(p(n)); w=imag(p(n)); Kc=2*real(r(n)); Ks=-2*imag(r(n)); 
sigma_=num2str(sigma); w_=num2str(w); Kc_=num2str(Kc); Ks_=num2str(Ks); 
if abs(sigma)>EPS 

x = [x 'exp(' sigma_ '*t).*']; 
if abs(Kc)>EPS&abs(Ks)>EPS 


elseif abs(Kc)>EPS, x = [x Kc_ '*cos(' w_ '*t)']; 


elseif n<=N & abs(imag(r(n)))<EPS 

if abs(p(n))>EPS, x = [x num2str(r(n)) '*exp(' num2str(p(n)) '*t)']; 
else x = [x num2str(r(n))]; 


if "isempty(k), x = [x ' + ' num2str(k(end)) '*dirac(t)']; end 


E.18 Decimation, Interpolation, and Resampling 


y=decimate (x, M, N, ) 

- This process filters the input sequence x with an LPF and then resamples 
the resulting smoothed signal at a lower rate, which is the opposite of 
interpolation. 

- y=decimate (x, M) reduces the sample rate of x by a factor M to pro¬ 
duce a decimated sequence y that is M times shorter than x. By default, it 
employs an eighth-order lowpass Chebyshev type I filter. Note that x must 
be longer than 3 times the filter order. 

- y=decimate (x, M, N) uses an Nth order Chebyshev filter. 

- y=decimate (x, M, 'fir') uses a 30-point FIR filter. 

- y=decimate (x, M, N, ' fir') uses an N-point FIR filter. 
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y=interp (x, M, 3y> fc) 

- This inserts zeros into the input sequence x and then apply an LPF. 

- y=interp (x, M) increases the sampling rate of x by a factor of M to 
produce an interpolated sequence y that is M times longer than x. 

- y=interp (x, M, L, fc) specifies L (= 4 by default) for filter length and 
fc (= 0.5 by default) for normalized cut-off frequency. 

- [y,B] =interp (x,M, L, fc) returns a vector B of length 2*L*M + 1 
containing the filter coefficients used for the interpolation. 


y=upfirdn(x,B,Mi,Md) 

- This can be used to change the sampling rate by a rational factor. 

- It upsamples x by Mi (i.e., inserts (Mi-1) zeros between samples), applies the 
FIR filter B, and downsamples the output by Md (i.e., throws away (Md-1) 
samples between samples). 

- The default values of Mi and Md are 1. 


y=resample(x,Mi,Md,B) 

- This can be used to change the sampling rate by a rational factor. 

- y=resample (x. Mi, Md) resamples x at Mi/Md times the original sam¬ 
pling rate, using a polyphase filter implementation where Mi and Md must 
be positive integers. The length of y will be ceil(length(x)*Mi/Md). If x is a 
matrix, resample () works down the columns of x. 

- It applies an anti-aliasing (lowpass) FIR filter (designed using firls() with a 
Kaiser window) to x during the resampling process. 

- y=resample (x,Mi,Md,B) filters x using a FIR filter with coeffi¬ 
cients B. 

- y=resample (x,Mi,Md,N) uses a weighted sum of 2*N* 
max(l,Md/Mi) samples of x to compute each sample of y. Since the 
length of the FIR filter used by resample() is proportional to N(= 10 by 
default), you can increase N to get better accuracy at the expense of a longer 
computation time. If you let N = 0, a nearest neighbor interpolation is 
performed so that the output y(n) is x(round((n — l)*Md/Mi) +1) where 
y(n) = 0 if round((n — l)*Md/Mi) + 1 > length(x)). 

- y=resample (x. Mi, Md, N, beta) uses beta as the design parameter for 
the Kaiser window used to design the filter where its default value is 5. 

- [y, B] =resample (x. Mi, Md) returns the filter coefficient vector B 
applied to x during the resampling process (after upsampling). 

- If x is a matrix, the routine resamples the columns of x. 


y=detrend(x) 

- y=detrend (x) removes the best straight-line fit from vector x. 

- y=detrend (x, 0) removes the mean value from vector x. 
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E.19 Waveform Generation 


chi rp (t, fSV’trl, f 1, ' type ' ) swept-frequency cosine generator 
pulstrao (t, D, pulse) pulse train generator 

rectpuls (t, D) sampled aperiodic rectangular pulse generator 

square(t,D), sawtooth (t, D) square, sawtooth/triangular wave generator 
tripuls skew) sampled aperiodic triangular pulse generator 


E.20 Input/Output through File 


% input_output_data .m 
x=[l 2]; y=[3 4 5]; 

save sig x y % save x and y in a MATLAB data file 'sig.mat' 

display('After y has been cleared, does y exist?') 
if (exist('y')~=0), disp('Yes'), y 
else disp('No') 

load sig y % read y from the MATLAB data file 'sig.mat' 
disp('After y has been loaded the file sig.mat, does y exist?') 
if isempty('y'), disp('No'), else disp('Yes'), y, end 
fprintf('x(2)=%5.2f \n', x(2)) 

save y.dat y /ascii % save y into the ASCII data file 'y.dat' 

% The name of the ASCII data file must be the same as the variable name, 
load y.dat % read y from the ASCII data file 'y.dat' 
str='prod(y)'; % ready to compute the produce of the elements of y 
eval(str) % evaluate the string expression 'prod(y)' 





Appendix F 

Simulink® 


According to the MATLAB documentation [W-5], Simulink® is software for mod¬ 
eling, simulating, and analyzing dynamic systems. It supports linear and nonlinear 
systems, modeled in continuous time, sampled time, or a hybrid of the two. Sys¬ 
tems can be multirate, i.e., have different parts that are sampled or updated at 
different rates. 

Simulink® provides a graphical user interface (GUI) for building models as 
block diagrams, using click-and-drag mouse operations. Simulink includes a com¬ 
prehensive block library of sinks, sources, linear and nonlinear components, and 
connectors. Models are hierarchical, so you can build models using both top-down 
and bottom-up approaches. You can view the system at a high level, then double¬ 
click blocks to go down through the levels to see increasing levels of model detail. 
This approach provides insight into how a model is organized and how its parts 
interact. 

After you define a model, you can simulate it either from the Simulink menus 
or by entering commands in the MATLAB® Command Window. The menus are 
convenient for interactive work, while the command line is useful for running 
a batch of simulations with a parameter swept across a range of values. Using 
scopes and other display blocks, you can see the simulation results while the sim¬ 
ulation runs. The simulation results can be put in the MATLAB workspace for 
postprocessing and visualization. MATLAB® and Simulink® are integrated so 
that you can simulate, analyze, and revise your models in either environment at 
any point. 

To start Simulink, you must first start MATLAB. Consult your MATLAB docu¬ 
mentation for more information. You can then start Simulink in two ways: 

• Click the Simulink icon on the MATLAB toolbar. 

• Type “simulink” (without the quotation marks) at the MATLAB prompt (like 
“>>”) in the MATLAB Command Window or use the “sim()” command inside 
a MATLAB program. 

On Microsoft Windows platforms, starting Simulink displays the Simulink Library 
Browser as depicted in Fig. F.l. The Library Browser displays a tree-structured 
view of the Simulink block libraries installed on your system, from which you can 
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Fig. F.l Simulink Library Browser window 
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copy and move (click/drag) the blocks into a model window and build models. The 
procedure of creating or editing a Simulink model is as follows: 

- A new empty model file (window) can be created by selecting File/New menu 
or clicking “Create a new model” button on the library browser’s toolbar. An 
existing one can be opened by selecting File/Open menu or clicking the Open 
button on the library browser’s toolbar and then choosing/entering the file name 
for the model to edit. 

- Copy and move (click/drag) the blocks you want into the model window. 

- Connect the blocks by clicking at an (input/output) point of a block and drag to 
an (output/input) point of another block. 

- To draw a branch line, position the pointer at a point on the existing line (wire), 
press and hold down the CTRL key, press the mouse button, and then drag the 
pointer to another point. 

To simulate the created/edited Simulink model, select the Simulation/ 
Configuration_Parameters menu (in the model window) to open the Configuration 
Parameters window in which you can set the simulation parameters including the 
start/final(stop) times, and then press the CTRL + T key (on the keyboard) or select 
the Simulation/Start menu on the toolbar of the model window. To see the simulation 
results, double-click the Scope block. 

Figures F.2 and F.3 show the Signal Processing and Communication Blocksets, 
which enables you to design and prototype various signal processing and commu¬ 
nication systems using key signal processing algorithms and components in the 
Simulink® block format. 

(cf.) If you see an error message that a Simulink model file cannot be saved 
because of character encoding problem, keep the erroneous part of the model 
file in mind, click OK to close the error message dialog block, use a text 
editor to modify the erroneous part in the designated file named “***.err”, 
and then save it with the extension name “mdl” instead of “err” so that it can 
be opened in another Simulink session. 
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Fig. F.2 Signal Processing Blockset available in the Simulink Library Browser window 
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Communication Blockset | 

(Integrators: (integrate and Dump, Windowed Integrator,... 
Basic Comm Functions [c; e g Uence Operations: (insert Zero (Depuncture), Puncture,... 

(AWGN Channel, Binary Symmetric Channel 
Channels Multipath Rayleigh Fading Channel 
(Rician Fading Channel 


Continuous-Time Eye and Scatter Diagrams 
Discrete-Time Scatter Plot Scope 
Discrete-Time Signal Traiectory Scope 
Error Rate Calculation, Triggered Write to File 



Fig. F.3 Communication Blockset available in the Simulink Library Browser window 
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Cascade form, 309 
Causal, 30, 85, 208 
Causality, 30, 225 
Causal sequence, 208 
Characteristic equation, 369 


Characteristic root, 369 
Chebyshev I filter, 311, 314, 324 
Chebyshev II filter, 312, 314, 326 
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Parallel computation of two DFTs, 194 
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Passband ripple, 307-308 
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Pulse response, 18 

Pulse transfer function, 297 

PWM (pulse-width modulated), 382 
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Quadrature multiplexing, 124, 184 
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Sinusoidal function, 5 
Sinusoidal sequence, 5 
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Stable, 29 

Starred transform, 268, 297 
State, 362 
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State equation, 50, 53, 362-363, 364, 370-376 
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State transition matrix, 364—365 
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State vector, 362 

Step-invariant transformation, 282-283 
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Stopband edge frequency, 307-308 
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Superposition principle, 13, 15, 16 
Symmetric sequence, 145, 146, 236, 238 
System, 17 
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System function, 18, 31, 225 

T 

Tapped delay lines, 26-28 

TDM (Time-Division multiplexing), 124 
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Time resolution, 182 

Time reversal, 215 

Time sampling method, 279 

Time shifting, 88, 139, 148, 214, 389 

Transfer function, 17, 31, 368 

Transmission matrix, 38 

Transportation delay, 293 

Transposed direct form, 37,434 

Trapezoidal rule, 288 

Tustin’s method, 288-292 

Two-dimensional DFT, 199 

Two-dimensional Fourier transform, 106 

U 

Uncertainty principle, 67, 155 
Unilateral (one-sided) z-transform, 208 
Unit impulse function, 3, 8, 10, 11, 45, 386 
Unit impulse sequence, 3, 10, 11 




465 


Unit sample response, 16 
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Unit step function, 3, 362 
Unit step sequence, 3, 362 
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Wagon-wheel effect, 8,258 
White spectrum, 81 
Whittaker’s cardinal interpolation, 264 
Windowing, 193 


Windowing method (for FIR filter design), 333 
Windowing property, 90, 139, 185 

Z 

Zero, 31, 212 
Zero-insertion, 176 
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z-transform, 208, 213,406, 407, 408 
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“Thispage left intentionally blank.” 



Index for MATLAB routines 


MATLAB 
routine name 

Description 

Page 

number 

bilinear() 

bilinear transformation (optionally with prewarping) 

442 

butter() 

designs Butterworth filter with an order and cutoff 
frequency 

310, 436 

buttordO 

the order and cutoff frequency of Butterworth filter 

310, 436 

cfirpm() 

designs a (possibly complex) FIR filter 

332, 344 

chebylQ 

designs Chebyshev I filter with an order and cutoff 
frequency 

311,436 

chebylorder() 

the order and cutoff frequency of Chebyshev I filter 

311 

cheby2() 

designs Chebyshev II filter with an order and cutoff 
frequency 

312, 438 

cheby2order() 

the order and cutoff frequency of Chebyshev II filter 

312 

chirp() 

swept-frequency cosine generator 

452 

conv() 

(linear) convolution 

154, 423 

conv_circular() 

circular convolution 

424 

cpsd() 

cross power spectral density 

429 

c2d0 

discretization (continuous-to-discrete conversion) 

442 

CTFS exponentiaK) 

find the CTFS coefficients in exponential form 

425 

CTFT_poly() 

CTFT of a polygonal signal 

118 

decimate() 

Reduces the sampling rate to produce a decimated 
sequence 

450 

deconv() 

deconvolution 

424 

dimpulseO 

impulse response of a discrete-time system 

431 

detrend() 

remove the best straight-line fit or the mean value 

451 

dfilt 

digital filter structure conversion 

443 

DFS 

discrete Fourier series 

425 

DFT 

discrete Fourier transform 

425 

dlsim() 

time response of a discrete-time system to a given 

432 

dstep() 

step response of a discrete-time system 

432 

DTFT 

discrete-time Fourier transform 

425 

d2c() 

discrete-to-continuous conversion 

442 

dtmf_decoder() 

DTMF (dual-tone multi-frequency) signal decoder 

205 

dtmf_generator() 

DTMF (dual-tone multi-frequency) signal generator 

202 

ellipO 

designs elliptic filter with an order and cutoff 
frequency 

437 

fft() 

fast Fourier transform (FFT) 

426 

fftshift() 

swaps the first and second halves 

427 
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filter() 

the output of a digital filter (with an initial state) to an 

434 

filter cas() 

filtering in a cascade form 

445 

filterJatc_nr() 

filtering in a nonrecursive lattice form 

447 

filter late rf) 

filtering in a recursive lattice form 

447 

filter_par() 

filtering in a parallel form 

445 

firlO. fii20 

designs a FIR filter using windowing 

332, 439 

fircls(), firclsl() 

designs a FIR filter using constrained least squares 

332, 441 

firls(), firpm() 

designs a FIR filter using equiripple or least squares 

332,440 

firrcosO 

designs a FIR filter using raised cosine 

332 

Fourier_analysis() 

CTFT analysis of an LTI system with a transfer 
function 

105 

freqs() 

frequency response of a continuous-time system 

433 

freqz() 

frequency response of a discrete-time system 

433 

hilbertO 

analytic signal with Hilbert transform on the 
imaginary part 

111 

ifftO 

inverse (fast) Fourier transform 

426 

ilaplace() 

inverse Laplace transform 

394, 449 

impinv() 

impulse-invariant discretiztion of a continuous-time 
system 

441 

impulse() 

impulse response of a continuous-time system 

431 

impz() 

impulse response of a discrete-time system B[z]/A[z] 

431 

interp() 

increase the sampling rate to produce an interpolated 
sequence 

450-451 

interpolation_discrete() 

discrete-time interpolation (Sec. 5.4.4) 

271 

invfreqsO 

identifies continuous-time system from its frequency 
response 

448 

invfreqz 

identifies discrete-time system from its frequency 
response 

448 

iztrans() 

inverse z-transform 

221, 449 

jordan() 

Jordan canonical form of state equation 

379 

laplace() 

Laplace transform 

449 

latc2tf() 

lattice structure to transfer function 

347 

load 

load (read) a file 

452 

IsimO 

time response of a continuous-time system to a given 

432 

music_wave() 

melody generator 

200 

par2tf() 

parallel form to transfer function 

347 

prony() 

identifies a discrete-time system based on its impulse 
response 

447 

pulstran() 

generates a pulse train 

452 

rectpuls 

generates a rectangular pulse 

452 

resampleO 

change the sampling rate 

451 

residue() 

partial fraction expansion of a Laplace transform 
expression 

394, 449 

residuez() 

partial fraction expansion of a z-transform expression 

220, 449 

save 

save (write) a file 

452 

sos2ss() 

second-order sections to state-space description 

347 

sos2tf() 

second-order sections to transfer function 

347 

sos2zp() 

second-order sections to zero-pole form 

347 

specgramO 

spectrogram (old version) 

427 

spectrogram() 

spectrogram 

427 
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ss2sos() 

state-space description to second-order sections 

347 

ss2tf() 

state-space description to transfer function 

347 

ss2zp() 

state-space description to zero-pole form 

347 

step() 

step response of a continuous-time system 

432 

stmcb() 

identifies a discrete-time system 

448 

tfe 

(discrete-time) transfer function estimation 

448 

tf21atc() 

transfer function to lattice form 

347,443 

tf21atc_my() 

transfer function to lattice form 

446 

tf2par_s() 

transfer function (in Laplace transform) to parallel 

444 

tf2par_z() 

transfer function (in z-transform) to parallel form 

347, 443 

tf2sos() 

transfer function to second-order sections 

347 

tf2ss() 

transfer function to state-space description 

347 

tf2zp() 

transfer function to zero-pole form 

347 

tripulsO 

generates a triangular pulse 

452 

upfirdn() 

upsamples, applies a FIR filter, and downsamples 

451 

windowing() 

various windowing techniques 

427 

xcorr() 

correlation 

42, 423 

xcorr circular() 

circular correlation 

425 

zp2sos() 

zero-pole form to second-order sections 

347 

zp2ss() 

zero-pole form to state-space description 

347 

ztrans() 

z-transform 

449 
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